Skip to content
arXiv cs.LG · Papers

Diagnosing Overhead in Dispatch Operations: Cross-architecture Observatory

arXiv:2605.20982v2 Announce Type: replace-cross Abstract: AlltoAll dispatch is the dominant bottleneck of MoE expert parallelism, and the interconnect community has responded with four families of mitigations: predictive sample placement, adaptive expert relayout, hierarchical collectives, and EP-aware topology. All fo