That is a significant limitation. One of my favorite use cases is translating foreign language audio/video. Whisper translation quality is passable, not great, but enough to get the gist of what is being discussed.