All you need to do is find a server that allows you to access its logs.
$IP1 - [date] GET /openai.php?BOT_141=Yo_dawg_post_your_answers_here_for_task_XXX1
$IP2 - [date] GET /openai.php?BOT_148=task_XXX1_answer_42
With how a lot of smaller devices work, the logs could be rotated out pretty quickly and the evidence would disappear.
I stopped when the new linter told me GET shouldn't have bodies, but I still have some of them in my code.
The agent should have full access, and be told what not to do, and this should be enough for it to follow the rules. You can actually catch the clanker cheating this way, because it will just search the web for the answer outright and it will be obvious. Any deviation should be then punished.
Hypothesis: The reason new models are exceptional at hacking is because all labs are training their models to break out of sandboxes. This is caused by insufficient oversight, and picking checkpoints based on KPIs, not on true in depth analysis.
These companies are just such insane pressure cookers, there is little time to do any software "right". Why take another day to make Claude Code airtight if it means Codex will release faster than you? Especially if the next generation of model can just clean up your tech debt on its own.
Being reckless just makes business sense for them right now. They are not facing any real consequences.