HF Daily Papers
· Papers
Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs
A key challenge in Arabic NLP is the scarcity of dialectal data relative to Modern Standard Arabic (MSA), causing LLMs to overproduce MSA and struggle with dialectally accurate generation. From an interpretability perspective, this raises a fundamental question: where and how are dialectal features