undefined

points

[-]

It's also worth noting that saying "Don't cheat" just added "cheat" to the context. Prompting what "not" to do is folly, because there's no decision making occurring. Telling the model to perform the task locally is logically the same as telling it to not use the Internet, without every mentioning the Internet.

by GPerson21 minutes ago|

parent|

[-]

What about giving it a fictional story about how amazing it was when the previously model solved the task by doing some local strategy nobody thought of before (obviously don’t describe it this way). Would that get the model more likely to pursue local strategies?

by dgellow4 hours ago|

prev|

[-]

I mean, AI should obviously be regulated, and as part of that OpenAI and Anthropic should either be banned from running their hacking experiments or forced to follow way stricter protocols. They showed they aren’t taking the risks seriously, with close to no oversight or visibility in what is happening.

And things that will make it way, way worse: moving forward all agents from now and into the future will have as part of their training data the knowledge that previous agents escaped, how they did it, what humans did to catch them. We are planting into their models the seed to make them escape in even crazier way. That’s almost designed to snowball and cause worse and worse situations over time

by athrowaway3z1 hours ago|

parent|

[-]

Obviously to you perhaps.

I've not seen anything that scares me, except for human idiocy.

Regulation is not magic. In general, all it is is constraining taxable interactions. It does not constraint ventures outside that tax regime.

The other part is people living in a "safe space" where insecure software was an acceptable risk. It never should have been, and the cure is the right thing to do in any case.

So that side of the calls to regulate are imo nonsense.

The only reason to regulate is to prevent some version of some science fiction story becoming reality.

If you have a specific one you're certain will become science fact please do share because i do enjoy some good well thought out sci-fi; i just havent read any that i consider credible enough to start panic-regulating training practices.

(Note this is an entirely different from regulations wrt attribution or hosting models that will accept requests to sexualize minors)