Skip to content
arXiv cs.CL · Papers

Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervision

arXiv:2603.07025v2 Announce Type: replace Abstract: Speech Large Language Models (LLMs) that understand and follow instructions in many languages are useful for real-world interaction, but are difficult to train with supervised fine-tuning, requiring large, task-specific speech corpora. While recent distillation-based