upvote
> So the question is can they keep the pricing up on the older ones a few years down the line

They don't expect to keep the prices flat over time, and everyone involved will have planned for this. Prices are highest when they're the newest and greatest (part of why it's valuable for neoclouds to be first in line for new models), and drop year by year as newer GPU models can do equivalent work at lower cost.

You can see a pretty cool dataset of this at [1]; H100 prices where $3/hr in 2023, and dropped linear-ish to $1.75/hr by 2025. And also the notable exception that prices are up this year due to shortage.

[1] https://semianalysis.com/gpu-pricing-index/

reply
hm. I should have written that more precisely, but I thought it was implied/obvious that it would go down to some degree or another. I didn't mean it would literally remain flat. it's a question of how much they drop though, and I don't think they know for sure, because there are new technologies that are really just being held back by manufacturing scale and anti-competition which otherwise could cause larger than anticipated pricing drops for older hardware. like.. how could you read what I wrote in that comment and conclude that I needed you to explain that the prices would drop?
reply
Why aren’t you talking about how A100 and H100 prices have again spiked and in some cases are higher than 2023! (This chart you posted isn’t fully accurate but even it admits that a100 prices are basically flat since 2024)

Micheal berry doesn’t know shit about GPU pricing or depreciation schedules. A100 demand is very high and easily 2 dollars an hour for reserved right now.

B200 and Vera reubin don’t help much if you don’t benefit from quantization, and that’s exactly my situation and many other AI research orgs situation.

A100s are going to continue making money per hour until 2030. Mark my words.

reply