The reviewer moved the grade more than the model did
396 blinded peer reviews from a fleet of coding agents. Peer grades rank models similarly to public benchmarks—until you look at which model did the grading.
Blog
What running several coding agents side by side actually costs, how long the work takes, and how it is graded. Every number comes with its date and where it was read from.
396 blinded peer reviews from a fleet of coding agents. Peer grades rank models similarly to public benchmarks—until you look at which model did the grading.