upvote
Inference, in and of itself, can't be completely unprofitable. Unless you're purely talking about Anthropic?

But

> If you want LLMs to continue to be offered we have to get to a point where the providers are taking in more money than they are spending hosting them

Suggests you just mean in general, as a category, every provider is taking a loss. That seems implausible. Every provider on OpenRouter is giving away inference at a loss? For what purpose?

reply
Do you have sources? I would be interested to read them
reply
Probably the best roundup is Ed Zitron at https://wheresyoured.at

Half the articles are paywalled but the free ones outline the financial situation of the SOTA providers and he has receipts

reply