Only issue I have found with llama.cpp is trying to get it working with my amd G... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		calgoo 21 days ago \| parent \| context \| favorite \| on: A guide to local coding models Only issue I have found with llama.cpp is trying to get it working with my amd GPU. Ollama almost works out of the box, in docker and directly on my Linux box.

Lapel2742 21 days ago [–]

>Only issue I have found with llama.cpp is trying to get it working with my amd GPU.

I had no problems with ROCm 6.x but couldn't get it to run with ROCm 7.x. I switched to Vulkan and the performance seems ok for my use cases

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact