upvote
I do hope for a future where LLMs are so good at patching zero-days that the NSA and all other nation-state 'cyberwarfare' departments (ie software privateers) lose most their capability.
reply
Zero-days are the least of our worries in the late 2020s and early 2030s
reply
On the other hand, nation-states will be able to run massive GPU clusters full of LLMs dedicated to cyberwarfare. They certainly have the resources to do it.

Imagine the Huggingface incident, but with an agent swarm that's deliberately malicious instead of just misaligned.

reply
Cyberwarfare isn't generally about hacking or stealing data. It's more like a footrace to a chessboard.

Most of the analysis and summary that demands LLMs is public data... massive amounts of data. Otherwise, it wouldn't be "warfare". It would just be spying.

reply
yes, that's why US is so keen on preventing China getting the gpus. And Israel is so bent on all AI. Trumendous advantages over the countries like Iran who will have to basically become hermit kingdoms to protect themselves.
reply
Seems just as likely that LMMs will have the opposite effect.
reply
> The NSA was aware of this vulnerability but did not disclose it to Microsoft for several years, as it intended to use the exploit

This is why agents discovering vulns en masse is pretty great in the long run, it gets ahead of these sort of malicious hoarding shitheads with more resources than ethics.

reply
Unless those who have access to the agents discovering the advance vulns are few, and those who have access to the agents writing vulnerable code are many, right?

That's the same situation as before AI: many developers don't have time/resources/expertise to prevent the advanced exploits, and few very advanced players do.

reply