Things like this have started to show up on eBay: https://www.ebay.com/itm/198383386991
reply 2X NVIDIA Tesla V100 32GB NVLink Water Cooled X99 E5-2686v4 AI Workstation PC
Item Quantity
Intel Xeon E5-2686 v4 CPU 1
2U CPU Cooler 1
Jingyue X99 Motherboard 1
DDR3 Memory 32GB
SSD 480GB
AMD Radeon R5 240 4K Display Card 1
NVIDIA Tesla V100 32GB SXM2 GPU 2
NVLink SXM2 Dual-GPU Baseboard 1
Corsair Water Cooling System 2
850W Bronze Power Supply 1
Dual-GPU 300G NVLink SXM2 Baseboard 1
8654 Data Cable 2
8654 to PCIe Adapter Card 1terrible deal
replyYeah. Not linking as an endorsement -- I do think it's cool, but it's not worth it for that price.
replyHow would destroying the GPUs prevent the model weights from leaking? By the time you get your hands on them the memory is powered off for a long enough time that a cold-boot style attack is impossible.
replyWould you bet your trillion dollar company on that? Or would you smash up the garbage [to you] memory chips to be sure.
replyIt's volatile memory, not flash.
reply> The shear amount of these cards otherwise heading towards the landfill is staggering.
replyThe thought of throwing away working cards sounds so bizarre to me. I can't believe companies would dispose them into the landfill like that, it is at least worth giving away for refuse.
There’s a long history of corporations doing evil things to ensure their business model succeeds
replyI genuinely hope that is the case. The market is absolutely bananas now. I actually now own devices that went up in 'value' since purchase. This is not normal ( and a little scary ). This, on the other hand, is an invitation to properly recycle otherwise unwanted hardware.
replyIsn't this the same thing with 32 GB already on a PCIe socket?
replykinda, they put that on a PCIe socket, but it's passive. Meaning no fan. If you try inference on that it overheats in 1 minute unless you have it inside a server case.
reply