arXiv cs.LG
· Papers
Prism Transformer: Progressive Head Schedules for Hierarchical Attention Processing
arXiv:2606.27449v1 Announce Type: new Abstract: Multi-head attention conventionally partitions the hidden dimension equally across all heads at every layer, enforcing an identical representational subspace dimension (dh = dmodel/h) throughout the models depth. In this work, we identify this uniform allocation as a fund