arXiv cs.LG
· Papers
Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatory
arXiv:2605.20982v2 Announce Type: replace-cross Abstract: AlltoAll dispatch is the dominant bottleneck of MoE expert parallelism, and the interconnect community has responded with four families of mitigations: predictive sample placement, adaptive expert relayout, hierarchical collectives, and EP-aware topology. All fo