upvote
I've kinda stopped looking at token pricing. Argon might be the same token pricing as Sol, but in Artificial Analysis' testing, Argon costs 5.8x more to run their coding tasks and 2.2x more for their general index.

Likewise, you look at Artificial Analysis' general index and it cost $8,708 to run with Opus and $2,407 to run with Argon so even if Argon's token price doubles, it won't be the same price as Opus.

Sonnet is cheaper than Opus per-token, but in their coding tests Sonnet burns through enough tokens that it's 7.5% more expensive.

So much depends on how token efficient something is and whether it gets you a good result or not, right?

Plus, if one is using a plan instead of paying token rates, what does my $200 get me from OpenAI, Anthropic, or Google?

It just feels very hard to compare pricing given that the number of tokens used can vary so much. In Artificial Analysis' coding tests, Sonnet used 7.1x more tokens than Sol. Sonnet and Sol might have the same per-token pricing, but there's a huge difference in the number of tokens used.

reply
Yeah, this is one of the most interesting challenges around model price comparisons.

This was hardly a consideration a year ago, when many model tasks could be tested using a single prompt and it was hard to spend more than a dollar.

reply