r/LocalLLaMA
· Communities
NInfer day0 support for Qwen3.8 27b: ~200 tok/s generation, with tons of engine improvments
Qwen3.8-27B is finally here, and NInfer already has Day-0 support! Weights: https://huggingface.co/neroued/Qwen3.8-27B-NInfer Just update to the latest source and give it a try. On a single RTX 5090, NInfer can still reach around 200 tok/s generation with speculative decoding. NInfer has also improved a lot since my la