Skip to content

Latest

arXiv cs.CL Papers

Beyond Attack-Success Rate: Action-Graded Severity Scale for Tool-Using AI Agents

arXiv:2607.07474v1 Announce Type: cross Abstract: Agentic red-teaming benchmarks report whether an injected agent was compromised as a single bit: the attack succeeded, or it did not.…

arXiv cs.CL Papers

A Word-Level Digital Reader of the Prasthanatrayi with Sankara's Bhasya: Corpus, Method, and an Open, Offline Reading Aid for the Advaita Vedanta Canon

arXiv:2607.07282v1 Announce Type: new Abstract: The Prasthanatrayi -- the ten principal Upanisads, the Brahmasutra, and the Bhagavadgita, with Sankara's commentaries (bhasya) -- is the foundational corpus…

arXiv cs.CL Papers

Agon: Competitive Cross-Model RL with Implicit Rival Grading of Reasoning

arXiv:2607.07690v1 Announce Type: cross Abstract: Reinforcement learning from verifiable rewards (e.g. GRPO) is the engine behind today's reasoning models, yet it grades only the final answer.…

arXiv cs.CL Papers

RIMRULE: Improving Tool-Using Language Agents via MDL-Guided Rule Learning

arXiv:2601.00086v3 Announce Type: replace Abstract: Large language models (LLMs) often struggle to use tools reliably in domain-specific settings, where APIs may be idiosyncratic, under-documented, or tailored…

arXiv cs.CL Papers

Riemannian Geometry for Pre-trained Language Model Embeddings

arXiv:2607.07047v1 Announce Type: new Abstract: Understanding the geometric structure of pre-trained language model embeddings matters for interpretability and safety. We ask whether sentence-level classification signal lives…

arXiv cs.CL Papers

Evaluating RAG Metrics in Applied Contexts: An Experiment, Its Findings and Its Limitations

arXiv:2607.07302v1 Announce Type: new Abstract: This paper reports an empirical study evaluating the relevance of several RAG metrics. The experiment is based on a question-answering dataset…

arXiv cs.CL Papers

AnyPoC: Universal Proof-of-Concept Test Generation for Scalable LLM-Based Bug Detection

arXiv:2604.11950v2 Announce Type: replace-cross Abstract: While recent LLM-based agents can identify many candidate bugs in source code, their reports remain static hypotheses that require manual validation,…

arXiv cs.CL Papers

Comprehensive Evaluation of Large Language Model Responses: A Multi-Factor Scoring System

arXiv:2607.06940v1 Announce Type: new Abstract: The remarkable performance of large language models (LLMs) in linguistic tasks underscores an urgent need for comprehensive evaluation of their response…

arXiv cs.CL Papers

MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning

arXiv:2607.06974v1 Announce Type: new Abstract: Large language models (LLMs) increasingly improve their reasoning at test time via additional computation, yet most existing works treat each problem…

arXiv cs.CL Papers

LLMs Silently Correct African American English: Auditing and Mitigating Dialect Bias via Activation Steering

arXiv:2607.06845v1 Announce Type: new Abstract: African American English (AAE), a rule-governed dialect spoken by over 30 million people, is routinely misinterpreted and "corrected" by large language…