upvote

points

by LarsDu8819 hours ago |
comments
upvoteby NitpickLawyer18 hours ago|
next
[-]
> a flood of 8x B300 will be homelab ready in a few months

Haha, that's beyond wishful thinking, I'm afraid. We're not even seeing a flood of A100s (6 yo and several generations old). Every GPU is still being squeezed right now, and the trend will probably continue for the foreseeable future.

reply
upvoteby throwup23818 hours ago|
parent|
[-]
Last I checked AWS still sells EC2 instances using 2018 era GPUs. Most people underestimate just how much long tail demand there is and how long these cards last, despite the higher power consumption.
reply
upvoteby fauigerzigerk16 hours ago|
parent|
[-]
Yes, but if data center space gets tight, it creates an incentive to replace old inefficient models with better ones, i.e. sqeueeze more performance out of limited data center space.
reply
upvoteby thway1526903710 hours ago|
parent|
next
[-]
IIRC some companies were running campaigns like "we buy your old hardware so you won't sell it in aftermarket and crash the prices". It all ends in landfill.

I wouldn't be surprised if RAM cartel or nvidia will attempt something like that, plus nvidia already talks about license-locking GPUs.

Also, again, IIRC, IBM hardware already works this way. There are almost no aftermarket when I last checked for them because it's all locked up and useless.

reply
upvoteby largbae10 hours ago|
parent|
prev|
[-]
Maybe, but A100s and H100s were air cooled. Space is just part of the problem.
reply
upvoteby x18746318 hours ago|
prev|
next
[-]
The world is bigger than the US. If the political climate in the US obstructs the build out, the build out will occur somewhere else.
reply
upvoteby fauigerzigerk16 hours ago|
parent|
next
[-]
I agree, but it would have to be a place with plenty of energy and the only such place outside the US is a war zone.

Perhaps one option is building data centers along with solar power plants in sunny countries that have a lot of space. I'm not sure about the water/cooling situation though.

reply
upvoteby SR2Z11 hours ago|
parent|
[-]
Well, lots of countries have energy surpluses from hydro or cheap coal.

It would certainly fit the pattern of Bitcoin farms clustering near dams.

reply
upvoteby fauigerzigerk2 hours ago|
parent|
[-]
Wasn't that mostly China? It would have to be countries that are not under chip sanctions.
reply
upvoteby seviu16 hours ago|
parent|
prev|
next
[-]
It’s called pacing the frontier
reply
upvoteby Drupon18 hours ago|
parent|
prev|
[-]
[flagged]
reply
upvoteby swingandamiss19 hours ago|
prev|
next
[-]
No, they'll be shipped off to Asia where technology is embraced.
reply
upvoteby DaSHacka17 hours ago|
parent|
[-]
The rise of China due to hand-over-fist ceeding of power and influence fueled in equal parts by the right and left is so astonishing it'll certainly go down in the history books (written in Mandarin, of course).

Bonus points when the morons are doing so because they get all their political news from a Chinese platform. The [Americans] have gone insane.

reply
upvoteby mullingitover10 hours ago|
parent|
[-]
The rise of China is due to the tyranny of the markets and the fact that firms laser-focused on quarterly growth buy and liquidate those trying to do responsible, sustained growth. Those that sold their factories were able to swallow domestic competitors who didn’t do so.

The political system just does whatever the captains of industry tell them to do.

reply
upvoteby FuriouslyAdrift15 hours ago|
prev|
next
[-]
There are 300 racks of nVidia A100 servers for sale from a refurber right now on eBay...
reply
upvoteby viccis18 hours ago|
prev|
[-]
>Possible data center bans incoming

A lot of the data center build out has been bipartisan. Unless Dems realize they need to listen to their constituents to avoid a 2028 bloodbath (they probably won't), I wouldn't count on that to save us from RAM/GPU prices.

reply