upvote
hm. I should have written that more precisely, but I thought it was implied/obvious that it would go down to some degree or another. I didn't mean it would literally remain flat. it's a question of how much they drop though, and I don't think they know for sure, because there are new technologies that are really just being held back by manufacturing scale and anti-competition which otherwise could cause larger than anticipated pricing drops for older hardware. like.. how could you read what I wrote in that comment and conclude that I needed you to explain that the prices would drop?
reply
Why aren’t you talking about how A100 and H100 prices have again spiked and in some cases are higher than 2023! (This chart you posted isn’t fully accurate but even it admits that a100 prices are basically flat since 2024)

Micheal berry doesn’t know shit about GPU pricing or depreciation schedules. A100 demand is very high and easily 2 dollars an hour for reserved right now.

B200 and Vera reubin don’t help much if you don’t benefit from quantization, and that’s exactly my situation and many other AI research orgs situation.

A100s are going to continue making money per hour until 2030. Mark my words.

reply