r/LocalLLaMA
· Communities
Ubuntu, CUDA, llama.cpp , nvcc versioning
The CUDA tool kit in apt is waaaaaaaay too old. I’ve been struggling with compute issues after all the other tweaking. Ubuntu latest is 12.0 newest is 13.3, I have a Blackwell and was dumbing it way down, 5060 ti 16gb, doubled the compute once fixed Had to specify the path on the llama.cpp though. Such a gem to find, t