PIRL: From Open-Loop Exploration to Closed-Loop Reinforcement Learning [R]
TL;DR: Most RL post-training algorithms optimize the current batch and move on. But after an update, did the new policy actually become better? We introduce Policy…
TL;DR: Most RL post-training algorithms optimize the current batch and move on. But after an update, did the new policy actually become better? We introduce Policy…
I'm really confused about what the point of the prompt injection was (speaking as an author). Is it just a study? I would really prefer that…
We can currently answer the meta-reviewer via AC confidential comment, but they just posted the following tweet: https://x.com/neuripsconf/status/2081991451236319328?s=46&t=HWfJoLgHxGH2W5l-o3mPJw Where it says: “Please post your answers to…
ML research is progressing at breakneck speed where frontier labs in both academia and industry have access to considerably large computes (GPUs). Where do small labs…
Hi everyone, I have a manuscript under review at Pattern Recognition (Elsevier), and I'm a bit confused about the Editorial Manager status. My timeline is: Submitted:…
It looks like the post rebuttal button will change to official comment July 27 AoE. Will I be able to edit my rebuttal once that happens?…
I ran a solo evaluation project benchmarking six current frontier models: GPT-5.4, Claude Sonnet 4.6, Claude Opus 4.7, Gemini Pro, Gemini Flash, and Grok 4.3. I…
We have gates for code, infrastructure, deployment and model performance. But when it comes to the actual training artifact, the decision to proceed is often still…
Hi everyone! 👋 I built and trained the complete Transformer architecture from scratch using pure PyTorch (`torch.nn` primitives) based on the original "Attention Is All You…
Hello, I read a paper on a model named DONUT that extracts text from documents, which became my inspiration for this little project. Initially I wanted…