arXiv stat.ML
· Papers
A Function-Space Dichotomy for Compositional Learning: Exponential Sub-Optimality of the Neural Tangent Kernel
arXiv:2607.06382v1 Announce Type: new Abstract: A persistent empirical observation is that trained neural networks outperform their neural tangent kernel (NTK) limit on tasks with compositional structure, yet a quantitative account of $textbf{when}$ and $textbf{by how much}$ has been lacking. Working on the unit circ