upvote
I think what you've said here is unfair and overly cynical; nowhere have I read Chris or any of the Anthropic people make the claim that LLMs definitively are conscious. What they say is that there is increasing uncertainty, and evidence - for which they show receipts - backing up that uncertainty.

Personally, I have been unconvinced by any of these definitive yes or no answers to "are LLMs conscious?" - in both directions. The "they are not / can not be conscious" side relies too heavily on mechanistic reductionist arguments that can apply equally to neurochemical processes in the human brain - and yet, it seems that humans, with brains made of these neurochemical processes, are conscious. At the same time, the "they are definitely conscious" answers seem to generally rely too heavily on self-deception and lack of reality testing.

To be able to say something definitive here, it seems to me that one would need to say definitively what this experience is. I have not heard any of the loud voices in the arena - not Chiang, not Giulio Tonini, not Karl Friston, etc - do so. Therefore I find Anthropic's uncertainty, and careful, caring investigative process, well grounded given the evidence.

reply
My aim isn't cynicism so much as an interest in clear an evidence based information about these systems which are clearly important technological developments for the future. It may turn out that there is something analogous to cognition going on and that would be quite significant and require us to think differently about the technology, but we need to be very sure of something like that.

> Therefore I find Anthropic's uncertainty, and careful, caring investigative process, well grounded given the evidence.

I'm inclined to agree mostly, but from the outside its impossible to separate marketing, belief, scientific inquiry, and just plain enthusiasm. Its all to opaque.

reply
I will concur that it's too opaque.
reply
The point here, Chris Olah is literally claiming he has seen into the abyss. Who are you disagreeing with?
reply
I'm saying that the burden of proof is on Chris Olah.
reply