Skip to content

Latest

arXiv cs.LG Papers

Between Gradient and Natural Gradient: A Continuum of LoRA Initializations

arXiv:2607.26247v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) fine-tunes large pretrained models at a fraction of the cost of full fine-tuning, but its performance depends strongly…

arXiv cs.LG Papers

Optimal Causal Annotations: An Application to Casenotes in Social Services

arXiv:2502.10605v4 Announce Type: replace-cross Abstract: Problem definition: Estimating causal effects of interventions is central to policy and operations, but outcome data are often missing or costly…

arXiv cs.LG Papers

Mitigating Compounding Error via Video Representation Regularization

arXiv:2607.27036v1 Announce Type: cross Abstract: Video diffusion-based world models enable long autoregressive video generation for robotics, autonomous driving and simulation tasks, yet sliding-window autoregressive inference suffers…

arXiv cs.LG Papers

RAGuard: A Layered Defense Framework for Retrieval-Augmented Generation Systems Against Data Poisoning

arXiv:2607.26339v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) systems ground large language models (LLMs) in external corpora, but this reliance exposes them to corpus poisoning: maliciously…

arXiv cs.LG Papers

Dynamic Parameterization Is Not Dynamic Inference

arXiv:2607.26192v1 Announce Type: new Abstract: Input-dependent controller coefficients are often treated as evidence of dynamic inference or computational savings. This interpretation conflates three properties: coefficient variation,…

arXiv cs.LG Papers

Weak-to-Strong On-Policy Distillation

arXiv:2607.26246v1 Announce Type: new Abstract: On-policy distillation (OPD), which aligns a student with the teacher's token-level distribution on the student's own rollouts, is an effective paradigm…

arXiv cs.LG Papers

Shared SFT Lessons Across Alignment, Model Organisms, and Toy Models

arXiv:2607.26173v1 Announce Type: new Abstract: Alignment training, model organisms, and toy models are usually treated as separate research areas. But projects in all three frequently use…

arXiv cs.LG Papers

Data Fusion and Contrastive Alignment for Unconstrained IR Molecular Structure Elucidation

arXiv:2607.26164v1 Announce Type: new Abstract: Automated molecular structure elucidation from infrared (IR) spectroscopy data has seen significant advancements in recent years, but its broad applicability is…

arXiv cs.LG Papers

Meta-Learned Reward Shaping for Reinforcement Learning from Human Feedback

arXiv:2607.26094v1 Announce Type: new Abstract: Reinforcement Learning from Human Feedback (RLHF) is the standard approach for aligning large language models with human preferences, but its quality…

arXiv cs.LG Papers

Crossing-Free Probabilistic K-Line Forecasts Without Retraining

arXiv:2607.26792v1 Announce Type: cross Abstract: Probabilistic K-line forecasting describes uncertainty in four complementary prices, namely open--high--low--close (OHLC). However, it introduces two consistency problems: quantile crossing and…