The stock market crash caused by AI companies halting their planned build outs may in practice cause RAM to remain unaffordable.
replyHow does a stock market crash increase RAM prices (when RAM demand goes down)?
replyOr would it affect people's purchasing power. I guess to some extent it does for people with significant investments in the stock market, but that's not a huge percentage of the people wanting to buy RAM or devices with RAM
The second and third and fourth-order exposure to AI spending is maybe bigger than you think. The blast radius if it pops could be quite large. Patrick Boyle had an interesting video discussing this recently https://www.youtube.com/watch?v=wTiYaWFP59Q
replyI don’t think the effects on the hardware market of open weight models triumphing has been reflected upon enough. It’s not clear that it will be less impactful if every enterprise decides to build for predominantly on-premise inference. In fact, before the question is ultimately decided, we’re probably heading towards a few years where hobbyists, enterprises and ‘hyper scalers’ are all competing for certain parts in common. Ram booked through 2027 sounds about right.
replyCompanies are avoid risks, and at this stage, sometimes, I feel that all cloud providers are just buying RAM that they would have bought anyway. Now it's ensure that no company will be willing to pay x digits just for cards. One of my clients is stuck in "we are doing things on premise but we are too cheap to spend a few 100k in cards but we don't want to go on clouds.
replyLast thing i heard was that large companies are starting to seriously spend on ai infrastructure (think nvidia clusters rather than tokens from openai or anthropic) to fine-tune and run custom models.
replyThis might become the driver for memory and chips demand in the near future.
But i don’t know, of course, we’ll i guess.
Fable would have a much bigger userbase if Anthropic didn’t remove a zero data retention option because muh safeguards
replyOr if it didn’t constantly kick people off fable. It won’t talk to me about gardening or computing.
replyIt will happily walk me through all the legal and illegal ways to systematically kill rodents.
At least it is on-brand for something used by militaries that want to target civilians, I guess.