X · @TencentHunyuan
· X / Twitter
🚀 We’ve open-sourced AngelSpec, an end-to-end speculative decoding framework supporting both training and deployment. On Hy3-A21B, DFly delivers a…
🚀 We’ve open-sourced AngelSpec, an end-to-end speculative decoding framework supporting both training and deployment.On Hy3-A21B, DFly delivers a 1.98–2.40× end-to-end speedup over autoregressive decoding across tested concurrency levels from 4 to 64, with 10.5–11.8% higher throughput than DFlash.Training code and Hy3-