r/MachineLearning
· Communities
Reproducing OpenAI’s “persistently beneficial models” – GRPO trait install barely moves. Ideas? [P] [R]
TL;DR: I’m reproducing the trait-persistence result from arXiv:2606.24014 on one RTX 3090. Before I can test persistence I need to install a trait via RL — and my GRPO run moves the trait only +2.4 points (95% CI [+0.2, +4.8]) when I need ~+15. Training is mechanically healthy and I’ve ruled out the obvious culprits. L