> Can you run an industry level LLM at home?
replyAssuming that by "at home" you mean using ordinary hardware, not something that costs as much as a car. Yes, very slowly, for simple tests. (Not proprietary models obviously, but quite capable ones nonetheless.) Not exactly viable for agentic coding that needs boatloads of tokens for the simplest things. But then you can run smaller local models that are still quite capable for many things.
I’m very good at the handcrafted stuff, I’ve been doing this a while. I don’t feel like giving up my self sufficiency, I just feel like the writing is on the wall.
replyBy "you" I actually meant this hypothetical person who's only good enough for AI assisted. Though even for us who are already experienced, we should keep the manual stuff even if it's just as going to the gym. I don't see myself retaining my skills for long by just reviewing LLM output.
replyYes sorry, I didn’t think you were addressing me directly, just adding my own thoughts.
replyI agree totally with the sentiment, and I am concerned about my own skills atrophying.
The costs just aren't that high. They could be 10x higher and it still wouldn't be a huge deal.
replyCan you build a computer at home?
replyThere is absolutely nothing self-sufficient about computer hardware
Or generate electricity? Or grow enough food to survive? Medicines?
reply"Self-sufficiency" arguments coming from tech nerds are so tiring.
No, and that's the reason we're now paying twice what we paid a couple years ago. But I can write software at home.
replyWe're already vulnerable to enshittification in so many areas, why increase the list? How does that work in my favor at all?