upvote
200 kW/rack is absolutely insane to me. The power consumption of these facilities is just...ridiculous.
reply
With respect to consumption, it’s pretty efficient vs older traditional servers, though I know workloads like that aren’t completely fungible. Nonetheless is bears keeping in mind that a single GB200 NVL72 rack provides 1.4 ExaFLOPS of AI compute (at FP4 precision, ideal circumstances, but this is envelope math all around). So it’s power efficient, for what it is.
reply
Oh, I have no doubt it is functionally efficient. I'm just amazed given the system deployments I've been party to, and the tiny amount of per rack energy usage comparatively speaking given the functionality of those systems.

Like, what in the good god damn are we using all this energy for?

reply
Since you and me and everyone else will foot the elecricy bill. Energy consumption or efficiency is not a concern.
reply
So what's the theory that goes with this about why cnbc are reporting that openai are walking because they want newer nvidia hardware? CNBC are clueleess? People at openai are lying to cnbc? cnbc are fabricating stories while drunk?

There has to be some theory to explain the story to be consistent with this comment.

reply
Something is probably happening but I don't know what it is. Maybe this is really a negotiation over price.
reply
OpenAI is a unreliable narrator as long as Sam is in charge. Full stop. EM_DASH.
reply
Yes and CNBC is comically rife with payola content. I just want to know who’s buying.
reply
Diedra is a solid reporter with pretty good access and understanding.
reply
I agree with you more than I agree with the parent comment.

To use the hit HBO TV show silicon valley analogy, it is far more likely that "the bear is sticky with honey" will happen at Oracle than at Open AI. Some kind of game of telephone gone wrong at some point and now the people responsible at Oracle must double down in order to kick the can to the next quarter and not appear clueless.

Statutory disclaimer: I am not affiliated with either Open AI or Oracle and have no insider information. All of this is mere conjecture and has no basis in reality.

reply
>cnbc are fabricating stories while drunk?

Don't forget the possibility that it's AI slop.

reply
Diedra Bosa is a good journalist.
reply
> CNBC are clueleess?

That sounds about right.

> People at openai are lying to cnbc?

Remove "to cnbc" and that's a yes.

> cnbc are fabricating stories while drunk?

Maybe not drunk but likely high.

reply