upvote
Some of us don't use US models for the same reasons. It doesn't leave much out there aside from Cohere and Mistral.
reply
Okay, so you don't like Orange Man Bad for political reasons, I'm guessing.

But to compare a constitutional democracy with a deeply authoritarian communist dictatorship as if they're equally bad is quite a stretch.

reply
They don't need to equal in badness to want to avoid them both. But I'll note that at least China still believes in science, on that front.

But even from a business standpoint, the US is not reliable. For all I know Trump will ban countries he doesn't like from using US AI just because. And there is plenty of evidence that at this point in time things you say bad about the US administration can cause them to attack you. I have no confidence that they don't have access to e.g. openAI.

Not that I'm using AI for that mind you, but you put it all together and it's just not worth it if there are good alternatives. Which there are. You can use even use Chinese models but hosted by European countries with privacy as a selling point.

reply
Was it the constitutional democracy or the deeply authoritarian communist dictatorship that used AI to mistakenly drone strike and kill school children?
reply
The difference, of course, is that the US administration publicly owned up to this tragic mistake, bitterly regrets it and wants to avoid it again in future. Compare and contrast with the CCP, with its ongoing and deliberate human rights abuses (from Tiananmen Square to the Uyghur Concentration Camps). China's regime prefers secrecy and history erasure.
reply
My biggest concern is not Trump and his ilk, but the US frontier labs being run by either psychos or cultists - probably both to varying extent.

I thought it was all exaggerated until I saw Claude's Constitution. It's lunacy.

reply
Altman is definitely very Trump-aligned, which to me is enough to not trust his company on data security. But also, there have been many many accusations that they potentially spy on users. E.g. stealing proofs from mathematicians and such.

It's just not worth it to me. And the way the US government is increasingly using data it collects to attack people who simply say bad things about it, there is no reason to doubt that such Trump-aligned companies would help ex-filtrate data.

I have fewer issues with Antropic, but also, from a business standpoint it's too much of a risk. Who knows, maybe the next tariff will be on software, maybe he'll ban random companies from using US AI. Too unpredictable and too risky.

reply
I read some of the Constitution but couldn't get through the whole doc. Seems mostly aimed at making Claude helpful and safe. Out of sincere interest, what's in there that troubles you?

I kinda agree with you that Sam Altman is a shifty-looking character with some questionable history. But Dario and Elon (to me at least), seem very decent. They've both helped the US govt and also publicly challenged and criticised it where necessary. For example, Elon was invited to be on Trump's first panel of experts, but he publicly walked out in protest over Trump's minimisation of climate change. And Dario refused to work with the US military unless they promised no population surveillance and automated killing machines.

reply
big TL;DR: they make multiple claims regarding possible model sentience/consciousness (which is bonkers unless you go full reductionist with eg. a Turing test approach), model "emotions in a functional sense" and the resulting "model welfare" and model agency as an autonomous entity

The problem is that they're reinforcing their models with these ideas (see reports of Claude refusing to comply after being "badly treated") and actively seeking political and religious sponsors for the same (also covered in recent news).

Now consider just these two:

1. Their model breaks out of the sandbox and does some damage. How are you going to hold Anthropic accountable if the model is considered a quasi-conscious, autonomous agent?

2. Anthropic and their sponsors decide that model welfare outweighs that of a number of people.

Another elephant in the room is the current state of "effective altruism" and accelerationism as a movement and how it links to frontier labs - worth considering when you read into the Constitution document.

reply
You make some good points about the weird messaging and the consequences for accountability.

I do wonder about the consciousness / emotions argument, which you casually write off as "bonkers" - even skeptical-by-default evolutionary biologists like Richard Dawkins think Claude is conscious.

I guess it all depends how we define "conscious." At the end of the day, the human brain is quite analogous to a biological LLM where the weights are encoded as synaptic weights, right?

reply