Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>LLM’s are inherently non-deterministic.

I'm not an ML guy but I was curious about this recently. There is some parameter that can be tuned to produce determinism but currently it also produces worse results. Big [citation needed], but worth a google if it's of interest. Otherwise in agreement with your post.



Temperature? Definitely tweaks the results…but I don’t know if “deterministic” is a term you can use in any way, shape, or form, in the context of LLMs.

https://www.ibm.com/think/topics/llm-temperature


Unless I’ve misunderstood something, setting a constant seed and a temperature of zero would give deterministic results.

Not good results necessarily, but consistent.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: