upvote
To finish your excellent analogy, adapted for today:

And Frog didn’t even bother to tie up the box or put it on a high shelf! The moment Frog’s back was turned, Toad opened the box and ate the cookies. Frog feigned surprise.

reply
Wow obscure reference, the cookies are the AI in this? OpenAI and anthropic are Frog and Toad?
reply
The cookies are the reward

Frog is OpenAI staff

Toad is the rogue agent

you can find the full story with a search for “frog and toad cookies story pdf”

reply
10/10.
reply