arXiv cs.CL
· Papers
Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought
arXiv:2607.20427v1 Announce Type: new Abstract: Mixture-of-Experts architectures have revolutionized scaling, yet the underlying logic of their routing remains a black box. In this paper, we uncover a fundamental governing principle: MoE routing is not merely selection, but a manifestation of Huffman Coding. We introdu