upvote
agreed, this doesnt even account for prompt caching or the fact that anthropic has substantial proprietary efficiencies on their inference stack specific to their models and scale.
reply
Thanks, that’s exactly what I was looking for!

And much more informative than the speculation and guessing in the article.

reply