Hey, I'm building exactly this.

I ask it to add subtitles, text effects, color grade my clips, cut out the silent parts.

100% open source

https://github.com/DonkeyCut/Donkey