X · @teortaxesTex
· X / Twitter
> Likely only 60-70% of the tasks are possible, so cheating is strongly incentivised Every eval has its own BrokenEval embedded inside. Rather than "c…
> Likely only 60-70% of the tasks are possible, so cheating is strongly incentivisedEvery eval has its own BrokenEval embedded inside. Rather than "cleaning" evals, we should take this as an opportunity to teach models sane behavior in impossible situations, rewarding giving upAlexander Barry: I wrote a brief article a