Skip to content
arXiv cs.CL · Papers

XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairs

arXiv:2502.19737v2 Announce Type: replace Abstract: We introduce XCOMPS in this work, a multilingual conceptual minimal pair dataset covering 17 languages. Using this dataset, we evaluate LLMs' multilingual conceptual understanding through metalinguistic prompting, direct probability measurement, and neurolinguistic pr