upvote
> Building a new benchmark won’t solve the problem, either.

It will if the benchmark is proprietary. If you can't train on it, then it's extremely difficult to game, and if it's hard enough, then it's economically more efficient to just...make the model smarter

reply