This site has AI features everywhere. There's an AI summary section, and a tooltip to summarize any section you highlight. Didn't see any mention of zero-weight viruses though.
replyView the original paper here: https://www.alphaxiv.org/pdf/2611.weight-space-misfolding
replyI did. "zero" came up with 0 results. "virus" had:
reply> Importantly, we do not claim in this paper to have created or demonstrated the equivalent of a virus that primarily operates in weight space. However, we have demonstrated the fundamental operations that form the building blocks of both the method of damage and the method of propagation, and evidence that this may take place in weight space – a realm into which we have almost no insight and a dearth of observability tools
perhaps they got a bad translation?
replythe apparent from the news that broke the other day - you can fuck with the weights and get so many results. so perhaps the headline is - those ablated and improved models you download from some weird sites, may be cursed or at least adulterated without anything suspicious looking on the surface. good news for all the anti-AI crowd, but I fail to see it as news.
replyi guess the real fun idea was if a model that fucks with weights was itself fucked with such that any model it fucks would become cursed and give it to the next one it edits. but they don't apparently have a proof of that yet.
replyAhh, so it's Reflections on Trusting Trust, but with LLMs instead of compilers.
replyhttps://www.cs.cmu.edu/~rdriley/487/papers/Thompson_1984_Ref...