X · @Alibaba_Qwen
· X / Twitter
Yes, we are back👑, with 206 tok/s on a single RTX 5090! Amazing Day-0 work from the SGLang team. Give it a try~@sgl_project
Yes, we are back👑, with 206 tok/s on a single RTX 5090!Amazing Day-0 work from the SGLang team. Give it a try~@sgl_projectSGLang: The king of small models is back! Qwen3.8-27B from @Alibaba_Qwen is open source, and Day-0 support is live in SGLang:- 206.1 tok/s decode on a single RTX 5090, with our NVFP4 plus DSpark- 38