Yeah I was wondering about this too. It seems like way too much per GPU considering the purchase price of a B200 was around $40k last time I checked. So if we naively ignore the price of electricity and maintanence, it would only take 5 months before renting is a worse deal than buying outright.
replyIt’s a supply and demand thing. Google would definitely be buying from nvidia and setting up themselves if nvidia had the capacity.
replySpaceX/xAi/musk are currently in a good market for “happening to own 100k cards we have nothing to do with”, and are exercising that control as hard as they can.