Legal Domain Adaptation of Modern BERT Models
arXiv:2606.28538v1 Announce Type: new Abstract: We investigate domain adaptation of modern BERT models in the legal domain. We further pre-train ModernBERT on all US court opinions…
Latest
A French OSCE Dialogue Dataset and Controllable Virtual Patient System for Clinical Training
arXiv:2606.28526v1 Announce Type: new Abstract: The clinical and communication skills of medical students are commonly assessed through Objective Structured Clinical Examinations (OSCEs), which consist of brief…
Developmental Trajectories of Situation Modeling and Mentalizing in Transformer Language Models
arXiv:2606.28524v1 Announce Type: new Abstract: Recent work suggests that Large Language Models (LLMs) are sensitive to the belief states of agents described by text, as measured…
Correct codes for the wrong reasons? validating LLMs as measurement instruments for theoretical constructs
arXiv:2606.28574v1 Announce Type: new Abstract: When a large language model (LLM) codes a construct in text as a human annotator would, that agreement makes the LLM…
Complementary RL: Towards Efficient Experience-Driven Agent Learning
arXiv:2603.17621v2 Announce Type: replace-cross Abstract: Reinforcement Learning (RL) has emerged as a powerful paradigm for training LLM-based agents, yet remains limited by low sample efficiency, stemming…
ELF: Embedded Language Flows
arXiv:2605.10938v2 Announce Type: replace Abstract: Diffusion and flow-based models have become the de facto approaches for generating continuous data, e.g., in domains such as images and…
When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search
arXiv:2606.27669v1 Announce Type: new Abstract: Search agents powered by large language models (LLMs) are increasingly used to solve complex information-seeking tasks, requiring multi-step retrieval and reasoning…
Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents
arXiv:2606.27472v1 Announce Type: new Abstract: Large language model (LLM) agents operate over long, multi-session interactions in which facts change: a user moves, a price updates, a…
The Context-Ready Transformer
arXiv:2606.27538v1 Announce Type: new Abstract: We introduce the context-ready transformer, a new recurrent neural network architecture built from a D-layer transformer block that pre-contextualizes each token…
Developmental approach reveals the statistical learning of Neural Language Models: Transformers generalize from the most abstract statistical patterns
arXiv:2606.27460v1 Announce Type: new Abstract: In this study, we use a developmental approach to investigate the statistical learning and mental representation of neural language models (NLM).…