LessWrong AI
· Communities
Measuring Reward-Seeking by Instilling Contrastive Beliefs
This is an unofficial automated linkpost. Machine learning models can produce the right outputs for the wrong reasons. Famous examples include a reinforcement learning agent that, rewarded for collecting a coin always placed at the right end of the level, learns to run rightward rather than to seek the coin itself [Lan