I'd be very surprised if it wasn't. Everything about that company turns me off. I've run across countless YouTube videos that are clearly Anthropic PR pretending to be real videos by regular people just trying it out and discovering how good Claude is. I'll stick with Gemini.
Building a good model generally means it will do well on benchmarks too. The point of the speculation is that Anthropic is not focused on benchmaxxing which is why they have models people like to use for their day-to-day.
I use Gemini, Anthropic stole $50 from me (expired and kept my prepaid credits) and I have not forgiven them yet for it, but people rave about claude for coding so I may try the model again through Vertex Ai...
The person who made the speculation I believe was more talking about blog posts and media statements than model cards. Most ai announcements come with benchmark touting, Anthropic supposedly does less / little of this in their announcements. I haven't seen or gathered the data to know what is truth
I see 25-29% here https://www.swebench.com/viewer.html for models released in Nov 2024 albeit not verified. gpt4o (Aug 2024) was 33% for swe bench verified.
Important point because people have a bias to underestimate the speed of ai progress.
Here’s the launch card of the sonnet 3.5 from a year and a month ago. Guess the number. Ok, Ill tell you: 49.0%. So yeah, the comment you replied to was not really off.
there is also Normal Computing[0] that are trying different approaches to chips like that. Anyway these are very difficult problems and Extropic already abandoned some of their initial claims about superconductors to pivot to more classical CMOS circuits[1]
Of course primary cause could be ZIRP, but AI definitely accelerated the problem.
Interns at big tech maybe impacted less, because their systems are so complex, but when I look at job boards or talk with engineers I see they're mentioning interns less, AI assisted coding more.
Bar for the interns is higher now, why do I need 3 interns to polish the product if I can complete 70% of the job with AI and hire 1 intern to fix other parts
Not sure your reply warrants any further expenditure of effort on my part, but for the benefit of other readers:
The bootcamp (actually, evening classes in coding run in cooperation with the public sector) regularly placed graduates with employers.
They’ve seen a big hit in this since AI, and companies have explicitly cited the fact that AI can complete the same tasks that these junior devs used to perform.