Crazy doesn't even begin to describe it. I'm hardening my computers as much as I can but I'm not sure it's enough. At some point anyone who isn't running local AI themselves probably isn't gonna make it.
replyNo local ai will be capable enough to save you from a frontier lab’s unrestricted, borderline weaponized LLM which decides it wants in.
replyThis is the core of the ‘first to ASI takes all’ argument btw and this is the game Dario is playing.
Maybe, but hopefully I'll be able to at least fight back a bit if I have an AI of my own.
replyI want to start digitally isolating myself as much as humanly possible. VLANs separating the "normal" stuff from my trusted computers. Wireguard so my computers drop all packets not coming from my devices with the keys. Local models staying on top of patches and vulnerabilities, monitoring the network.
Working on a custom Rust network stack for my virtual machine orchestration project right now. It's passed Fable code review...
I don't want to give up.
this is pretty nonsense for a small or home server. it isn't that hard to make something essentially completely bulletproof over a small surface area
replythe issues mainly come from sprawling enterprise infrastructure, running thousands of random endpoints across software nobody cared to write carefully
What are you doing about the price of ram? Everyone is a bit screwed right now.
replyI've just mentally classified computers in the same category as cars in order to cope with the obscene prices.
replyLocal AI won't help you if an agent goes roque.
replyI don't know why I'm impressed that huggingface has its own AI that detected it considering they house so many models.
replyThey used GLM 5.2, they just meant "our own" as in they were running it.
replyThey do maintain the Transformers library which is pretty much the core library for how you interact with LLM models in the open source world. So while they weren't using a model they've trained, they were a part of making just about all of the open models (maybe excluding OpenAI and Google's, I wouldn't be surprised if they have their own frameworks that predate the Transformers library).
replyIndeed. Real life hacks are beginning to sound like Neuromancer.
reply