Skip to content

Latest

arXiv cs.CL Papers

LogicIF: Towards Complex Logic Instruction Following

arXiv:2508.09125v3 Announce Type: replace Abstract: Instruction following has catalyzed the recent era of Large Language Models (LLMs) and is the foundational skill underpinning more advanced capabilities…

arXiv cs.CL Papers

MamaBench: Benchmarking LLM Robustness in Maternal and Child Health Diagnosis through Counterfactual Clinical Perturbation

arXiv:2607.14385v2 Announce Type: replace Abstract: Large language models achieve strong scores on medical benchmarks, yet these benchmarks evaluate each question in isolation, providing no measure of…

arXiv cs.CL Papers

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering

arXiv:2606.17799v2 Announce Type: replace-cross Abstract: Coding agents have become a major mode of software engineering, but the benchmarks we use to compare them were designed in…

arXiv cs.CL Papers

Cascading versus Joint Modeling for Hierarchical Offensive Language Detection

arXiv:2607.16790v1 Announce Type: new Abstract: Fine-grained offensive language detection organizes labels into a hierarchical structure, for which two modeling paradigms exist: cascaded decomposition and joint multi-task…

arXiv cs.CL Papers

L1 Augmented Attention as an Improved Vector Similarity Metric

arXiv:2607.18027v1 Announce Type: cross Abstract: Scaled dot product attention conflates directional alignment and vector magnitude, limiting its effectiveness as a similarity metric in Transformer models. We…

arXiv cs.CL Papers

ChipChat: Low-Latency Cascaded Conversational Agent in MLX

arXiv:2509.00078v2 Announce Type: replace-cross Abstract: The emergence of large language models (LLMs) has transformed spoken dialog systems, yet the optimal architecture for real-time on-device voice agents…

arXiv cs.CL Papers

Beyond Multilingual Averages: MTEB-PT, a Benchmark for Portuguese Sentence Encoders

arXiv:2607.04071v2 Announce Type: replace Abstract: Portuguese remains underrepresented in text embedding evaluation, despite being one of the most widely spoken languages in the world. As a…

arXiv cs.CL Papers

Diagnosing Correctness Probes under Self-Judgement Confounding

arXiv:2607.16799v1 Announce Type: new Abstract: Hidden-state readouts can predict whether language-model outputs are correct, but objective correctness (OC) usually agrees with the model's own self-judgement (SJ),…

arXiv cs.CL Papers

The Illusion-Illusion: Vision Language Models See Illusions Where There Are None

arXiv:2412.18613v2 Announce Type: replace-cross Abstract: Illusions are entertaining, but they are also a useful diagnostic tool in cognitive science, philosophy, and neuroscience. A typical illusion shows…

arXiv cs.CL Papers

RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation

arXiv:2607.16431v1 Announce Type: new Abstract: Small-scale language models (SLMs) are attractive for retrieval-augmented generation (RAG) in resource-constrained settings, but their limited capacity makes them highly sensitive…