Continued improvement is returns, making it inherently compatible with a diminishing returns scenario. Which I also suspect we're in now: there's no comparing the jump between GPT3.5 and GPT4 with GPT4 and any of the subsequent releases.

Whether or not we're leveling out, only time will tell. That's definitely what it looks like, but it might just be a plateau.