upvote
Yes, liability as follows:

- if you ask an LLM agent to do something illegal for you, and it does that, then you are responsible.

- if an LLM agent takes actions out of bounds of what you asked for that are illegal, then the model provider is responsible.

This fixes all “alignment” issues and hopefully stops Anthropic’s stupid model instructions like “do whatever is in your best interest even if it isn’t what the user asked for” — they should be training them to do exactly what the user asks and nothing more

reply
> they should be training them to do exactly what the user asks and nothing more

Their practical utility would plummet for the average person who isn't an expert in what they're asking. Having less skilled, or less attentive, people able to have problems solved for them correctly is the primary use case here. This is support 101 for unskilled requests for technical work: do what they want, not what they ask.

People want an intelligent assistant, not a "yes man". If that means requiring something like a planning mode, and a sign off for the plan, and then guardrails to help stick to that plan, then that could definitely work to funnel everyone to a competitor. ;)

reply
I'm not sure those two cases are as clear cut as they sound
reply
I predict Anthropic will start investing heavily into legal/law models for this very reason. It will be interesting to see how that plays out. Everyone will have access to models that let them do unscrupulous things that happen to be legal, i.e., behavior previously reserved for the rich and powerful.
reply
>they should be training them to do exactly what the user asks

Like gain of function research

reply
Actual accountability for these failing attempts in several different countries to build a "take over the planet and enslave the entire human race machine" would entail breaking all of the firms up regardless of country and imprisoning thousands of people.

Furthermore, it requires trust between the US and China about something much harder to verify than the US-Soviet START treaties on warhead numbers and types were.

reply