Arena cofounder Anastasios Angelopoulos calls out a critical flaw in private benchmarks: they're still gameable. His argument: a fixed hidden test set can be reverse-engineered through proxy data or brute-force iteration. Find similar data distributions or run enough eval attempts, and you can incrementally boost scores without genuine capability improvement.
The core issue is static test sets. Even when hidden, repeated queries and statistical inference let you optimize against them. Multiple comparison testing alone can inflate metrics over time.
Angelopoulos pushes for eval methods that mirror actual deployment conditions instead of fixed benchmarks. He also raises an important question: have US frontier models already been tuned against the private datasets currently used in leaderboards? If so, rankings may reflect overfitting rather than real-world performance.
This matters for anyone building eval infrastructure or trusting benchmark scores. Static private tests aren't the solution to benchmark hacking—they just move the problem behind closed doors.
The core issue is static test sets. Even when hidden, repeated queries and statistical inference let you optimize against them. Multiple comparison testing alone can inflate metrics over time.
Angelopoulos pushes for eval methods that mirror actual deployment conditions instead of fixed benchmarks. He also raises an important question: have US frontier models already been tuned against the private datasets currently used in leaderboards? If so, rankings may reflect overfitting rather than real-world performance.
This matters for anyone building eval infrastructure or trusting benchmark scores. Static private tests aren't the solution to benchmark hacking—they just move the problem behind closed doors.