HF Daily Papers
· Papers
When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling
People overthink; language models over-sample, and the extra effort can talk both into a worse answer. Reasoning systems answer a hard question by sampling it many times (test-time scaling), and the more they draw, the more often a correct answer turns up somewhere, so coverage, the fraction of prob