Note that Claude models could still do better in some cases, just that because of their refusal to answer sometimes and some weird formatting/stupid errors they make sometimes, they do fail more tests than they should.

In practice they might recover from those errors themselves if they notice it, so they would have better results, but the tests are mostly one-shot and they can either get it wrong or right, no 2nd tries (apart from the agentic ones and a few coding ones which have a limited number of turns available too).

That being said, the pricing and speed are accurate, regardless of the test results.