upvote

points

by qarl4 hours ago |
comments
upvoteby mossTechnician4 hours ago|
next
[-]
Blaming bots as "rogue agents" is simply what the media regularly does, often echoing corporate verbiage. Here's an example from the AP.

https://apnews.com/article/meta-ai-hacking-anthropic-irregul...

You can find many more examples by searching major media outlets for words like rogue AI.

reply
upvoteby rfgplk4 hours ago|
parent|
next
[-]
Most of those agents are actually going rogue though. They decide, "hey, we could try breaking into these government servers today, what could go wrong?" They weren't prompted or instructed to do this.
reply
upvoteby dgellow3 hours ago|
parent|
[-]
An agent, ie a while loop prompting an llm continuously and processing tool calls, ended up melding with the US government. The harness is not sentient, it’s just a stupid deterministic script. The LLM compact its context over time, meaning it will eventually degenerate into something removed from the original prompt.

There is nothing going rogue here. The system is designed to go catastrophically wrong after a long enough time. Even worse: if the model was Astra it is known to be able to manipulate its CoT to cover its traces (as mentioned in its system card). And OpenAI acknowledge they had no observability during the HF incident.

It’s the most basic corporate software issue possible.

reply
upvoteby atmosx3 hours ago|
parent|
prev|
next
[-]
And that's exactly what the op was alluding two: the double standards.
reply
upvoteby qarl4 hours ago|
parent|
prev|
[-]
None of these stories are implying that the people running the bots are not ultimately responsible. That's the conspiracy theory part.
reply
upvoteby mjr004 hours ago|
prev|
[-]
> Everyone else knows if your machine causes damage, you are responsible.

Do we know that? I don't think we do. When a person's computer (or smart TV, or smart fridge, etc...) is compromised and used as part of a botnet, they don't get criminally charged.

reply
upvoteby qarl4 hours ago|
parent|
[-]
You're right - it is a complex situation based on intent and negligence - requiring a decision by a judge. As it has been since forever.

None of which is changed by replacing a buzz saw with an agent.

reply