I tried to implement something very similar recently, and had the hardest time getting the LLM to produce anything remotely resembling actual ffmpeg commands.
You were using a weak LLM then. The difference between one of the leading edge LLMs like Gemini 2.5 Pro, o3, or Claude 4 and an average LLM or one you can run on your typical PC/laptop is night and day.