At the rate of development, also, will AI developed in 6 months from now be able to break a system that was secured by todays AI?
Now, you could argue that writing secure code ex-ante is harder than discovering an exploit. But you can hypothetically run the same "exploit finding" process on a first pass of code before it ships (e.g on the PR) given low enough token costs, which is where we're headed.
Even if that's true, one should not forget that:
When the hackers have breached something, awaits a reward.
E.g. a Bitcoin wallet, or learning something about a political competitor and getting rid of them.
(So the hackers can spend lots of ...)
I wonder about that though: if the price of the squeeze collapses to 0 because of this (think of what models and prices might be like a year from now), I think I know where all those out of work mathematicians can find gigs. We are going to need to invent a layer on top of, an evolution of or some new concept a level above "computer programming" that deals with meta-organization of code.