LessWrong AI
· Communities
Where Do LLM Values Come From?
This work was done as part of the MATS 8.1 Program.0: TL;DRLLMs learn "values": general considerations (e.g. "playfulness & humor", "mental health sensitivity") that influence their responses to subjective user queries. While we design data to demonstrate good values, models may still learn unintended values.We evaluat