In taking precautions against thieves who cut open satchels, search bags, and break open boxes, people are sure to cord and fasten them well, and to employ strong bonds and clasps; and in this they are ordinarily said to show their wisdom. When a great thief comes, however, he shoulders the box, lifts up the satchel, carries off the bag, and runs away with them, afraid only that the cords, bonds, and clasps may not be secure; and in this case what was called the wisdom (of the owners) proves to be nothing but a collecting of the things for the great thief.
True or false: LLMs can find security vulnerabilities?
True or false: LLMs can exploit security vulnerablities?
True or false: Any nation with significant resources can make an LLM?
For me these are all true. The last one in specific completely removes the concept of theft and changes it to "enemy nation". Enemy nations can be great thieves, and it's irrelevant, if you don't protect yourself against them you die and everything of yours is stolen.
LLMs are not going away, well, except for you and me maybe. Every state wants to wield digital and informational weapons like this.