upvote
> But the counter to that is that everyone else is becoming more compute efficient so maybe that advantage isn't what people thought it would be.

I'm not sure? If we have techniques to use the hardware even better, that will make the hardware even more valuable, won't it?

reply
But they aren't really competitive for cost in that size class.
reply
I could buy four of them for ~20k.

That's like four years of ChatGPT + Claude subscription.

Eight years if only ChatGPT, or sixteen years of the Pro 5x subscription.

reply
It's not particularly good value if you are just comparing $ with no other context. Point is just that it's accessible and so now Anthropic and OpenAI need to make both a performance proposition and a value proposition.
reply