I feel like "relatively" is doing a lot of work, there: at about $4k per GB10, that's $36k for a 1TB cluster. Cheap compared to equivalent H200's, but out of reach for home labs that aren't funded with OpenAI or Anthropic RSUs.
replyWhen the AI bubble pops those hardware prices will pop too.
replyMy hope is on Intel Crescent Island with 480GB. I don't need 8x H200 performance (and cost), but I would like to run GLM 5.2 Q8.
replyI'd love to too, but I guess Crescent Island with 480 GB will cost something like $10-12k or even more.
replyHope you're right! Can't wait!
reply