r/LocalLLaMA
· Communities
Gemma 4 26B/31B Q4 QAT vs Q4/Q5/Q6/Q8
What are your experiences with Gemma 4's QAT versions compared to their regular ones? So far I have mostly heard about regressions, but if you have a different experience or even benchmarks that are in favor of QAT, this is the thread to share them. Please share your positive or negative experiences. I think we really