X · @cwolferesearch
· X / Twitter
Super interesting practical application of KV cache compaction! This is one my favorite areas of research to read about recently. Lots of great papers…
Super interesting practical application of KV cache compaction! This is one my favorite areas of research to read about recently. Lots of great papers on the topic (beyond the STILL method mentioned in this post):- http://arxiv.org/abs/2506.06266- https://arxiv.org/abs/2602.16284- https://arxiv.org/abs/2503.10337- http