LessWrong AI
· Communities
Fable is SOTA at CIFAR Speedrun (& specification gaming)
Fulcrum is working on an AI R&D optimization benchmark. Here, we present results from one of our tasks, including preliminary results from Fable.For more detail on Fable’s solution, check out github.com/fulcrumresearch/cifar-10-speedrun.Summary: We gave current frontier models 100M tokens to see whether they could beat