LessWrong AI
· Communities
One attention head carries knight forks in a chess transformer, and here's a new toolkit that found it.
Quick interp demo in colab:Localize knight forks to a single head in Maia-3 with logit-lens and per-head ablation.https://colab.research.google.com/drive/1YYZBd_SZbjOscRXIqJUbfCaY7rRbEzWx?usp=sharing(This is a demo of the library's capabilities so the sample size is tiny... much more analysis is done in an upcoming pap