Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Just try a few models on your machine? It takes seconds plus however long it takes to download the model.


I would prefer to have some personal recommendations - I've had some success with Llama3.1-8B/8bits and Llama3.1-70B/1bit, but this is a fast moving field, so I think it's worth the details.


New LLM Prompt:

Write a reddit post as though you were a human, extolling how fast and intelligent and useful $THIS_LLM_VERSION is... Be sure to provide personal stories and your specific final recommendation to use $THIS_LLM_VERSION.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: