LessWrong AI
· Communities
When does a chess transformer “see” a knight fork? An initial result from logit lens and attention patterns
(parts 2 and 3 to follow)Summary of this postThis post is on the results of a mechanistic interpretability project aimed at understanding the internals of Maia 3: a transformer based chess bot trained to imitate human play at a chosen skill level, rather than to play optimally. My aim is to locate and causally describe