Look at how much we spend on single bombers, how many training runs can you do for that much?
Well, the money will stop when the value of problems the LLM can solve is not increased by adding compute. Since current LLMs are getting quite good at solving problems, that might be a while.