They don't expect to keep the prices flat over time, and everyone involved will have planned for this. Prices are highest when they're the newest and greatest (part of why it's valuable for neoclouds to be first in line for new models), and drop year by year as newer GPU models can do equivalent work at lower cost.
You can see a pretty cool dataset of this at [1]; H100 prices where $3/hr in 2023, and dropped linear-ish to $1.75/hr by 2025. And also the notable exception that prices are up this year due to shortage.
Micheal berry doesn’t know shit about GPU pricing or depreciation schedules. A100 demand is very high and easily 2 dollars an hour for reserved right now.
B200 and Vera reubin don’t help much if you don’t benefit from quantization, and that’s exactly my situation and many other AI research orgs situation.
A100s are going to continue making money per hour until 2030. Mark my words.