Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I run llama.cpp using Vulkan and AMD CPUs, no need to install any drivers (or management software for that matter, nor any need to taint the kernel meaning if I have an issue it's easy to get support). For example the other day when a Mesa update had an issue I had a fix in less than 36 hours (without any support contract or fees) and `apt-mark hold` did a perfect job until there was a fix. Performance for me is within a couple of % points, and with under-volting I get better joules per token.


Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: