LessWrong AI
· Communities
Testing LLMs on Undergraduate Music Theory
I spent the past week designing a test that I hoped would serve as a benchmark. But LLMs are improving faster than I expected, and my devilishly hard questions turned out to be a cakewalk.Here are the results of testing five modern LLMs on undergraduate music theory:As can be seen, the LLMs performed remarkably well. E