arXiv cs.CV
· Papers
The Professor: Multi-Teacher Unsupervised Prompt Distillation for Vision-Language Models
arXiv:2606.23897v1 Announce Type: new Abstract: Prompt distillation compresses large vision-language models (VLMs) such as CLIP into lightweight student models by matching teacher predictions on unlabeled domain images. PromptKD (CVPR 2024) established this paradigm with a single PromptSRC-finetuned ViT-L/14 teacher an