arXiv stat.ML
· Papers
Are we Merging the Right Models? Impact of Expert Training Duration on Model Merging for LLMs
arXiv:2607.11997v1 Announce Type: cross Abstract: Multi-task model merging combines separately trained expert models into a single model that handles all tasks without co-training. Standard practice merges experts at their optimal validation loss. We challenge this convention by systematically studying how training dur