r/LocalLLaMA
· Communities
I tested whether 27B Q8 or 35B Q6 is the better coding model on a 32 GB GPU. The more interesting result: neither was reliable enough to be its own final checker.
I started this because of the recurring question around Qwen 27B vs 35B on a single 32 GB card. In particular, some people reported that the dense 27B model seemed to catch coding errors better than the 35B MoE, despite the latter being larger. I built a block of tasks to compare the two and found some differences but