Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

To add to that, llama.cpp supports GBNF grammars, which allows generation of JSON, or even programming languages:

https://github.com/ggml-org/llama.cpp/blob/master/grammars/R...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: