I agree that the amount of investment thrown at these companies is absurd.

But I also think that their API token pricing represents a real margin over the inference costs for serving those tokens.

Both things can be true at once.