Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

is anyone doing online reviews of model performance ? (I know artificial analysis does some work on infrastructure and has an intelligence index)


The aggregate picture only tells you so much.

Sites like simonwillison.net/2025/jul/ and channels like https://www.youtube.com/@aiexplained-official also cover new model releases pretty quickly for some "out of the box thinking/reasoning" evaluations.

For me and my usage I can really only tell if I start using the new model for tasks I actually use them for.

My personal benchmark andrew.ginns.uk/merbench has full code and data on GitHub if you want a staring point!





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: