Also no political censorship, and it doesn’t report you to the police when it suspects you did something illegal. That really happened, by the way.
replyNow I want a local LLM server :( $25k is just so much money.
I'm building a local LLM server myself.
For about 8k€ you can have 170tps, ~6000 prefill.
replyA lot more with Haiku equivalents (Qwen3.8 27B) or gemini. It's not frontier, but not that far away.
MacBooks with large RAM and optimized for local models should be Apple's medium term goal.
reply> My local model never says no. I never get banned.
replySo much this. Plus everything else you mentioned. The freedom and control is real.
Exactly, that's the spirit. I pool the resources with some friends as well.
replydeleted
replyI think both of y’all glossed over the $25k of it all pretty quickly. This isn’t remotely an option for anyone.
reply