upvote
Why aren't they? You could put a human yes/ no prompt before any cycle the agent is running on, or not let it spawn sub processes, or anything like that. Why let it run autonomously enough that it can no longer have a simple way to completely stop it? (obviously not practical to do this during real use, but for evals? you could slow it down in lots of ways I would think)

Are you telling me we've been iterating on this for years and for convenience we just let the models call any tools or spawn any other model instances they like, and there was no design for harnesses that could control this done during that time?

reply
They aren't interrupted by humans because that would slow things down.

> Are you telling me we've been iterating on this for years and for convenience we just let the models call any tools or spawn any other model instances they like

Yes exactly.

> there was no design for harnesses that could control this done during that time

You could but no one wants that. You need to separate your imagination from reality. Just because something can be done in your head doesn't mean it's happening.

It's so easy, except it isn't because you don't control the actions of anyone or anything.

reply
They are, we're just dealing with tech workers that don't have ethics nor do they actually care if their work is harmful (see all the FAANG workers at American corporations, some of the most evil entities on the planet.

It's just that they don't care, as you said these are entirely made human systems. The idea that we can't write better software is both selfish and laughable.

reply
>I need to remember when I comment here that these are the kinds of people I am replying to.

People who dont buy into fantasism?

reply
> kill switches are not easy to build

We've had circuit breakers for nearly a century.

reply
And a circuit breaker has nothing to do with shutting AI off. What a strange comment.
reply