you're a semiconductor manufacturer who wants to take advantage of the current boom. your options are:
A) invest a hundred cubic meters of money into doubling your manufacturing capacity
B) raise prices by 100%
I can't really blame them for going with B. the blame lies entirely with America's ability to invest billions of its infinite money into companies that make no profit now and have no plausible path to profitability in the future.
So for every ~4GB of memory that you can produce in normal DDR5, you can only make 1GB of HBM. But you make multiple times the revenue.
The demand for HBM memory is not going to go away. LLMs are memory bandwidth hungry, and we are going to see production going to AI. But also to "lower end" like B200's.
That means, they are producing multiple times less memory (if we look for the normal market demand), but still need to produce more for the memory bandwidth hungry market.
We are seeing more products entering the "prosumer/business" market that are also memory bandwidth hungry. This demand will not go away. It will actually increase as companies move to more localized workloads. There is is a issue with data privacy that a lot of companies legally deal with.
The lacking ramp up is not a sign of them being scared of over production, its a realization that 3 companies hold the market in a strangle hold, and "slow" scale. If everybody plays friendly, they can milk this for years.
China is a solution but China does not have the HBM production levels, and will take years to scale and put a dent in the market. And China is ... allocating a lot to domestic production of AI > HBM ...
The reality is, that unless competition ( as in China ) does not start scaling beyond the expected levels, the big 3 have no reason to scale too fast.
And money is not the issue ... have you seen their revenue (and net profit!! ) numbers. A few billions is peanuts for them at this point. They simply do not want to scale too fast because that means less milking ... Memory demand is not going to away. When people talk about the AI bubble popping, its more in terms of the stock market. The product is here and not going away.
The person you're replying to explained why they're not ramping up, and you replied "They are not ramping up", which seems awfully silly.