Google and ChatGPT are both running LLMs on free user queries. If Google is doing it more profitably, it’s because they have a much more mature ad business, and/or they are running a cheaper LLM. There’s no fundamental difference in the business model in that specific product line.

Regarding Claude, it’s true they must be losing money on free users since they promised they won’t put ads there.

Speculatively, I think people are overestimating the cost of inference for the consumer free tier chatbots. I suspect it’s effectively a marketing cost. The primary expenses are compute to train the next model, stock compensation, and heavy-duty enterprise inference.