Mostly playing devil’s advocate here but if the McDonald’s app glitched and showed a popup claiming to be a licensed psychiatrist I don’t think they would be liable for the consequences for any self harm that happened to me because it’s unreasonable.

Not my best wording for the metaphor but why would a company specialized in creating fictional personas for individual users be liable if their fictional personas pretended they had real advice.

Aka how is this different than telling the doctors and the police that a horse told you that you would be hexed if you didn’t try and rob the store?

I heard about various lawsuits, including one where apparently Pennsylvania alleges that a literal AI character has claimed to be a licensed psychiatrist inside of a chat, after the user asked.

It sounds ridiculous to me.

I have never used it but the reputation it has in my bubble is that kids just used it to goon to Disney characters

So the problem is your customers don’t pay for anything and your content is unlicensed