upvote

points

by ActivePattern4 hours ago |
comments
upvoteby adam_arthur4 hours ago|
next
[-]
GPT 5.6 is far more token efficient at most tasks with similar performance. Especially so for Opus 4.8, still to be seen with Opus 5.

Where are you getting cheaper per dollar?

reply
upvoteby ActivePattern4 hours ago|
parent|
next
[-]
How are you supporting the claim that GPT 5.6 is "far more token efficient" than Opus 5? Tokens equal, output is cheaper for Opus 5 ($25/1M) than GPT-5.6-Sol ($30/1M), and it seems to outperform slightly on agentic coding benchmarks.
reply
upvoteby adam_arthur4 hours ago|
parent|
next
[-]
The first chart in the blog post shows a similar $/performance curve to GPT 5.6.

Where 5.6 has optionality to run much cheaper along the same performance curve at lower thinking levels.

There's a later chart that shows Opus 5 ahead, but seems like an esoteric benchmark rather than for common use. (Novel problem solving)

If they had a more efficient model at coding they would lead with that chart.

reply
upvoteby HarHarVeryFunny3 hours ago|
parent|
prev|
[-]
Token cost and token efficiency are two unrelated metrics, and anyways what really matters is neither in isolation - it's cost to complete a task.
reply
upvoteby conradkay3 hours ago|
parent|
prev|
[-]
https://www.anthropic.com/_next/image?url=https%3A%2F%2Fwww-...

It seems roughly equal according to Anthropic's benchmarks

reply
upvoteby shwaj4 hours ago|
prev|
[-]
It would still be the best model per dollar if the score was 2% lower instead of 0.1% lower. Would it be ok to still give it the highlight color then?

How big of a lie is too big? Especially when no lie needed to be told at all: many including myself would have noticed the tiny 0.1% deficit and been suitably impressed by the Opus 5 result.

I’ll admit this is a small deception by today’s standards. I’m one of those who believes in truth for truth’s sake.

Edit: typo

reply
upvoteby ai-x4 hours ago|
parent|
[-]
we don't know if it is 0.1% deficit, could be 0.05%
reply
upvoteby shwaj3 hours ago|
parent|
[-]
So highlight both then.
reply