upvote
> The other question I have is... who exactly is doing all of 1. Using AI right now 2. Making substantial money on it or getting real value and 3. Capacity constrained?

Almost all enterprise users for one. At least from what I have seen it is a massive productivity boost for coding and general research. If the costs were ~4x lower, we would be able to do much much more with them. Building datacenters will reduce the cost because increasing supply would reduce the cost.

> It's not like they triple data center capacity (and increasing AI capacity by, what, 10x? 20x?), stick them full of AI systems, and into that 10x+ greater AI capacity they can sell it at the prices they are now. Higher capacity would crash the selling price but the costs would be as high or higher than now.

This is false. Part of the costs are unit costs which are really high margin. I think the margins are around 50% to 60%. By increasing the capacity, the are bound to make even more profit.

But the other part is reflecting the lack of capacity.

reply
"Building datacenters will reduce the cost because increasing supply would reduce the cost."

That's great for us users but I'm talking from the point of view of the people trying to make money on the data centers.

"This is false. Part of the costs are unit costs which are really high margin."

Can you explain how everybody throwing their money at nVidia lowers the costs? When they are already apparently at max capacity?

Everybody trying to build a data center at once raises the costs of the data center. Everyone competing for power has already raised power prices and we've barely begun bringing this stuff online. Everyone demanding multiples of what nVidia is producing means nVidias isn't going to reduce prices any time soon.

Your use of "even more profit" also implies that you think that the AI world is making lots of money? nVidia is making lots of money. To a first approximation, everybody else involved has lost billions. Maybe not Apple. But everyone else you can name is deep in the negative on AI.

reply
> That's great for us users but I'm talking from the point of view of the people trying to make money on the data centers.

Why wouldn't they make money if they are the ones on whom money is thrown at?

> Can you explain how everybody throwing their money at nVidia lowers the costs? When they are already apparently at max capacity?

Increasing supply lowers the cost, I'm unsure which part of this is surprising.

> Your use of "even more profit" also implies that you think that the AI world is making lots of money? nVidia is making lots of money. To a first approximation, everybody else involved has lost billions. Maybe not Apple. But everyone else you can name is deep in the negative on AI.

The companies using AI are making money out of it. OpenAI will make money in the future but are losing it because of R&D and training.

reply
In xAI's case, they've gotten gas turbines installed on site with which to make up the electricity generation shortfall onsite. It's unclear exactly how long that short term solution is going to be there, but probably quite a while.
reply