Skip to content
arXiv cs.CL · Papers

TAKE: Trajectory-Aware Knowledge Estimation for Text Dataset Distillation

arXiv:2607.11898v1 Announce Type: new Abstract: Large-scale text corpora have become a quiet bottleneck in modern NLP, not just in storage, but in the accumulated cost of training, fine-tuning, and continual learning. We propose a text dataset distillation framework that reduces corpora to as little as 0.1% of their or