r/LocalLLaMA
· Communities
Qwen 3.6 27B Q5 on 3x2080ti: 55tps with llama.cpp. Can I squeeze out more?
CPU: Threadripper 3970X RAM: 128GB DDR4 GPUs: 3x2080ti 11GB The current best parameters to run it: llama-server --model Qwen3.6-27B-Q5_K_S.gguf --n-gpu-layers 999 --split-mode tensor --flash-attn on --cache-type-k q8_0 --cache-type-v q8_0 --ctx-size 16384 --batch-size 2048 --ubatch-size 1024 --threa