HF Daily Papers
· Papers
TurboServe: Serving Streaming Video Generation Efficiently and Economically
Streaming video generation is emerging as a new serving workload in which users interact with long-lived sessions that generate video progressively, chunk by chunk. Unlike offline video generation or typical LLM serving, streaming video generation must preserve session state across active and idle p