That sounds like a contradiction.
/J
Wish I built this a few years ago!
> 96 GB Dual NVIDIA RTX PRO 5000 w/ 1000W PSU (non-refundable) +$19,169
Though I don't think there's anything stopping you from trying to stuff an H100 into this machine if you want to BYO.
Depending on your use case, you might prefer native FP4 and FP6 low-precision support and 5th-generation Tensor Cores rather than what Hopper offers.
I think for training Hopper makes sense as it's generally a bit cheaper and the difference isn't that big, but for inference the difference widens a bunch makes a lot more sense to go with Blackwell.
That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.
Graphics:
(...)
+$18,399 192 GB Dual NVIDIA RTX PRO 6000 w/ 1000W + 750W PSUs (non-refundable) +$37,239
Memory:
(...)
192 GB DDR5 3600 MHz (4x48) +$1,874
yup, 87.8% of $42,412 is just two GPUs and a PSU. Even RAM is less than 5%.Still, you're right, I have a 1200W PSU for a single RTX Pro 6000, cost ~500 something, so still the PSU shouldn't be that large part of the total budget.
It would be great if China had more lithography machine....