r/LocalLLaMA
· Communities
Extened garlic to run Qwen3.5 35B A3B float8 at 55 tok/s on RTX 5060 Ti
In a previous post (https://www.reddit.com/r/LocalLLaMA/comments/1utefpr/running_qwen3_30b_a3b_at_50_toks_on_rtx_5060_ti/) there seemed to be great demand for bringing in Qwen3.5 35B. Some Gated Delta Network kernels later and here it is. It runs at 55 tok/s (61 when not recording - since the recording eats c