arXiv cs.CL
· Papers
Information-Theoretic Limits of Reliability and Scaling in Language Models
arXiv:2607.14112v1 Announce Type: new Abstract: Large language models (LLMs) are evaluated as though perfect reliability is achievable for any task given sufficient scale. We show this assumption is information-theoretically unjustified. Every generative task has a reliability ceiling that no model can exceed, determin