arXiv cs.CL
· Papers
Which Decisions Low-Bit Quantization Breaks, and How to Predict Them
arXiv:2608.06564v3 Announce Type: replace-cross Abstract: Quantization is known to hurt below four bits, but nobody can say which of a model's decisions will change at a given bit-width. This matters most where a model acts rather than answers: a compressed agent stops calling its tools and, one bit lower, loses roughl