Revealing Hidden Model Behaviors with Task-Specific Self-Reports
arXiv:2607.03640v2 Announce Type: replace Abstract: Fine-tuning can give a language model a hidden behavior--it may give false answers under a narrow condition, or give harmful advice…
Latest
Evaluating Prompt Scope and Demonstration Similarity in Local LLM Machine Translation
arXiv:2607.26286v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as general-purpose translation systems, but their behavior is usually evaluated under a single prompt…
Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers
arXiv:2512.17351v2 Announce Type: replace Abstract: Understanding architectural differences in language models is challenging, especially at academic-scale pretraining (e.g., 1.3B parameters, 100B tokens), where results are often…
MyoCardBench: A Real-World Data Benchmark for Evaluating Large Language Models in Clinically Authentic Cardiovascular Care Scenarios
arXiv:2607.25186v1 Announce Type: new Abstract: Background: Most medical large language model (LLM) benchmarks focus on examination knowledge or isolated tasks and may not reflect the longitudinal,…
Constrained CTC Decoding for Efficient Diacritic Restoration
arXiv:2607.18946v2 Announce Type: replace Abstract: In this work, we address diacritic restoration for Arabic speech transcripts. Most speech data are undiacritized, limiting the ability of modeling…
Eye Tracking Based Cognitive Evaluation of Automatic Readability Assessment Methods
arXiv:2502.11150v5 Announce Type: replace Abstract: Automatic methods for scoring text readability have been studied for over a century, and are widely used in research and in…
Stemma: Induced Decision Regions Reveal LLM Provenance
arXiv:2607.25880v1 Announce Type: cross Abstract: LLM provenance testing asks whether a suspect LLM belongs to the same lineage as a source. Existing black-box methods largely infer…
A Cross-lingual Comparison of Human and Classification Model Entrainment Behavior in Code-switched Speech Settings
arXiv:2607.25202v1 Announce Type: new Abstract: Conversational entrainment is well-studied in monolingual and written contexts, but remains underexplored in spoken code-switching (CSW). We present a novel cross-lingual…
Med-R$^3$: Enhancing Medical Retrieval-Augmented Reasoning of LLMs via Progressive Reinforcement Learning
arXiv:2507.23541v5 Announce Type: replace Abstract: In medical scenarios, effectively retrieving external knowledge and leveraging it for rigorous logical reasoning is of significant importance. Despite their potential,…
Building Large-Scale English-Romanian Literary Translation Resources with Open Models
arXiv:2509.07829v4 Announce Type: replace Abstract: Literary translation has recently gained attention as a distinct and complex task in machine translation research, yet translation by small open…