X · @teortaxesTex
· X / Twitter
RT Florian Brand: illustrative example: the software subset of the ECI comes with Mechanize's GBAEval, where GLM-5.2 scores 0, likely due to it being …
RT Florian Brandillustrative example: the software subset of the ECI comes with Mechanize's GBAEval, where GLM-5.2 scores 0, likely due to it being text-only (so it cannot verify its outputs). excluding this bench gives GLM-5.2 a huge jump. some of the top models don't have GBAEval scoresFlorian Brand: @teortaxesTex Th