The bottleneck right now isn't making hardware more powerful, it's manufacturing it fast enough. Hardware right now is expensive because of scarcity, and those with a monopoly on it have no incentive to change that.
replyThe Chinese would love to produce AI hardware much cheaper, but are blocked from doing so because US sanctions stop a Dutch company from selling them the machines capable of doing so. Coincidentally the companies with a monopoly happen to be in the US.
To be fair, the Dutch company is built on technology that was developed by the US Government, hence why there are restrictions.
reply[1]https://www.eetimes.com/u-s-gives-ok-to-asml-on-euv-effort/
Moore's law isn't as relevant with parallel workloads. If you can keep building more lanes you don't have to worry about making faster cars.
replySure, but it doesn't lower the cost or increase the efficiency of the system
reply