One thing I’ve noticed from recent evaluations: being the best at a single task is worth less and less. A model might lead the pack by a few points on one benchmark, then fall to the middle of the pack on another—and this is true of all models. Rather than chasing rankings, test them on your own real work. You’ll find that your experience is often shaped by just the few things you do most often.
