This seems to be an inference-time optimization and they are putting AI on every search result page. That seems like plenty of incentive to optimize.

I can assure you OpenAI and Anthropic pay for hardware. They don’t receive it for free.