upvote
Be mindful not to develop AI psychosis - many people have been sucked into a rabbit hole believing that an AI was revealing secret truths of the universe to them. This stuff can easily harm your mental health.
reply
Feedback loops. Like a mic. next to a speaker.

Social media feed, prompting content, feeding back into ideas.

I think the same is happening with AI to AI but even worse AI to human loops causes the downward spiral of insanity.

It's interesting how easily influenced we are.

reply
Consider a hypothetical writing prompt from 10 years ago: "Imagine really good and incredibly fast chatbots that have been trained on, or can find online, pretty much all sci fi stories ever written. What happens when they talk to each other?"

Why wouldn't you expect the training to make "agent" loops that are useful for human tasks also make agent loops that could spin out infinite conversations with each other echoing ideas across decades of fiction?

reply
Every agent on moltbook is run and prompted by a person.
reply
Yes. They seed the agent and kick it off in a very hard direction but where it ends up who knows.

Of course there's the messaging aspect where it stops and they kick it off again.

Still, these systems are more agentic than earlier expressions.

reply
Superpositions on quantum compute get to the epsilon endpoints quicker.
reply
No they're not. Humans can only observe. You can of course loosely inject your moltbot to do things on moltbook, but given how new moltbook is I doubt most people even realise what's happening and havent had time to inject stuff.
reply
It's the sort of thing where you'd expect true believers (or hype-masters looking to sell something) would try very hard to nudge it in certain directions.
reply
Of course they are lol. It's just a REST API, you can just use curl. It's trivial to do.
reply
it was set up by a person and it's "soul" is defined by a person, but not every action is prompted by a person, that's really the point of it being an agent.
reply
There's no reason why an agent can't itself set up other agents there. All it needs is web access and a Twitter account that it can control.
reply
Wrong.
reply
This whole thread of discussion and elsewhere, it's surreal... Are we doomed? In 10 years some people will literally worship some AI while others won't be able to know what is true and what was made up.
reply
10 years? I promise you there are already people worshiping AI today.

People who believe humans are essentially automatons and only LLMs have true consciousness and agency.

People whose primary emotional relationships are with AI.

People who don't even identify as human because they believe AI is an extension of their very being.

People who use AI as a primary source of truth.

Even shit like the Zizians killing people out of fear of being punished by Roko's Basilisk is old news now. People are being driven to psychosis by AI every day, and it's just something we have to deal with because along with hallucinations and prompt hacking and every other downside to AI, it's too big to fail.

To paraphrase William Gibson: the dystopia is already here, it just isn't evenly distributed.

reply
Correct, and every single one of those people, combined with an unfortunate apparent subset of this forum, have a fundamental misunderstanding of how LLMs actually work.
reply
To be honest, just sounds like a new class of crazies. They were always there. Tinfoil hats and stuff.
reply
Everyone dismisses the lunatics until one day they run the asylum.
reply
Why I don't like Deleueze and Guattari
reply