Skip to content
arXiv cs.LG · Papers

Training Hybrid Block Diffusion Language Models with Partial Bidirectionality

arXiv:2607.02805v1 Announce Type: new Abstract: High-throughput long-context generation is one of the central challenges for large language models. Generation is typically memory-bandwidth-bound rather than compute-bound: each decoding step must stream the accumulated key/value (KV) cache from memory, so bandwidth dema