I use ollama through a Mac app called BoltAI quite a bit. It’s like having a smart portable sci-fi “computer assistant” for research and it’s all local.
It is about the only thing I can do on my M1 Pro to spin up the fans and make the bottom of the case hot.
Llama3.1, Deepseek Coder v2, and some of the Mistral models are good.
ChatGPT and Claude top tier models are still better for very hard stuff.
It is about the only thing I can do on my M1 Pro to spin up the fans and make the bottom of the case hot.
Llama3.1, Deepseek Coder v2, and some of the Mistral models are good.
ChatGPT and Claude top tier models are still better for very hard stuff.