r/LocalLLaMA
· Communities
What should I test when comparing Qwen3.6-27b quants for real world effects that humans could reason about?
I tried to find some good comparisons on how different quants of Qwen3.6-27b perform in different scenarios, but I failed to find good information on what kinds of real world effects there are to running different quants like Q4_K_M, UD-Q4_K_XL, UD-Q5_K_XL, UD-Q6_K_XL and UD-Q8_K_XL. My main motivation would be to unde