Memory isn’t getting cheap soon, and you need a lot of it for local models
replyAll depends. The current technology will be cheaper in a year or two. The best cutting edge stuff will properly be even more expensive. But in 10 years time... we can run current SOTA models (or models that are equally good ) on our local hardware
replyAh yes, if you count in decades, for sure I expect to run them locally
replyWe had a thing called globalism that drastically reduced costs. Globalism right now is on life support. Given geopolitics, I don’t see how it’s going to survive.
reply