I run local models. Your op is absolutely wrong. To get a local LLM is at least a $1500 investment at the cheapest. $5000 if you want usable.
replyAt $1500 that's 75 months of $20/mo Claude which are MUCH better models than you can run locally.
If you already have that $1500 or $5000 setup though..
replyAt $1500 that's 75 months of $20/mo Claude which are MUCH better models than you can run locally.
replyThe point raised by this very article is that you can't depend on that. It's Flowers for Algernon As A Service.
deleted
replyThis calc is off. Using Claude for a few hours with the $20 plan will hit the limit for a week while the local model can process things 24/7.
replyRunning 24/7 doesn't make sense though, unless you're providing a service to others. But if it's just you then there has to be time taken to review+test what's being done and craft new prompts. And if that local hardware isn't decent enough it's impractical for anything serious that's interactive. Meanwhile I just take the Claude limits on stride and break, or if a week is pretty heavy then I augment with DeepSeek Flash via OpenRouter (does wonders in a single turn when I have Claude prompt it to handle implementation slices).
reply[dead]
replyOuch. I get ~45t/s with Qwen3.6 35B A3B, and around ~70-80 with my current model Ornith 1.5 35B A3B. Local models work a treat IMO if you've got decent hardware for it.
reply