r/LocalLLaMA
· Communities
I compared GGUF quants of Qwen3.6 27B to NVFP4, AWQ, AutoRound, and FP8
There's an interactive chart and some extra data in the blog post if you're interested. There are plenty of KL-divergence benchmarks for GGUF models, but most of them compare one GGUF quant against another. I wanted to know how those quants stack up against other commonly used formats (especially NVFP4). I tested 16 qu