Social engineering is an issue with regular support, with agents it's a lot worse. And with agents it's repeatable: if I find one conversation flow to get it to give me money I can instantly repeat that with a thousand fresh accounts, and then share the same "exploit" on reddit for everyone else
If frontier AI deployed at frontier labs is not capable of "resetting 2FA, issuing refunds, handling payment glitches, etc." then the current and near-future capability of AI is being severely overstated.
captain_renault_casablanca.gif