LessWrong AI
· Communities
LLMs are (still) mostly powered by imitative learning, not RL
Reinforcement learning from verifiable rewards (RLVR) is the hot new thing in LLM training. It’s so hot, and people spend so much time talking about it, that they sometimes lose sight of the big picture.Stepping back, LLMs can do lots of very impressive things. How? Where did those capabilities come from? Fundamentally