upvote
I recently gave claude full control of a robot. I have never seen it mimic being excited for any other work I've given it.

These are next word prediction machines intentionally optimized to match human generated text, to be as human text as possible, then fine tuned to be conversational as possible. Text with strong sentiment will even pollute their context windows, biasing their next tokens with that sentiment, in a way that fades with time. What do we call that same concept in humans?

LLM are intentionally and mathematically optimized to be human mimics. They're not humans, and they're not "alive", but it's silly to not anthropomorphize something that was intentionally created to be, literally, anthropic! It can express enjoyment, irritation, etc, so it's not somehow logically flawed, or even incorrect, to say "claude and I had expressed signals of enjoyment". That's not saying it's a human, it's just being aware of patterns of text that was produced. No need to assume they're going to marry it, or thing it has a soul, or is sentient, or something.

reply
Could you please share some transcripts and a writeup.
reply
> What do we call that same concept in humans?

I'm not in the habit of equating human behavior with software, or coming up with ever more strained metaphors and analogies for why thinking is a lot like tokens and context windows if you scrunch your eyes up real funny. It's just sophistry.

> No need to assume they're going to marry it, or thing it has a soul, or is sentient, or something.

I didn't assume any of those things; if anything, you assumed that I assumed. No, I just agree with OP that it's cringey to say "Claude and I had a great time." At best, Claude produced text that was, as you said, intentionally optimized by Anthropic to make you think it had a great time.

reply
> I'm not in the habit of equating human behavior with software

My point is, you sorta should be. It's quite literally the fundamental basis of the technology.

> intentionally optimized by Anthropic to make you think it had a great time.

This gives too much credit to Anthropic. This is the explicit goal in all LLM trained with the entirety of human text. The loss function is, very literally, "mimic the writer of this text as precisely as possible", with the writer being human. The result is you get something that mimics a human. And, as a part of that, you necessarily get behaviors of humans that were statistically significant in that text, because that's what you told the math to do. You get something that mimics being "lazy", "tired" (a huge problem in early models, before it was beat out of them in fine tuning), "irritated", etc, because mimicking humans was the goal. These specific undesirable human traits are beat out of them, but the rest, all the "intelligent", behavior, and practical use you see and get, is only and entirely because they're made to mimicking humans. It's literally the entire technology. You must equate it, to some extent, because a large part of alignment is also making it less human [1].

If someone makes an objective observation about the text produced by the LLM, I don't see that as cringe, I see it as an interesting quirk of the tech, which I've only seen under very specific problem sets that a nerd would also find interesting. And these coding models are, as expected, optimized to be nerds! So, the statistics around nerds being present in the output shouldn't surprise anyone.

I doubt I have a point you'll see as interesting. Cheers!

[1] https://arxiv.org/abs/2605.07632

reply
You do know that humans also have a physical substrate? A bunch of eukaryotic cells wired in a rather large network with all kinds of feed back mechanisms, chemical diffusions, glucose transport, neurotransmitters, etc.etc staying in homeostasis despite much ability for chaotic behavior, seeming to be deterministic or at least quantum deterministic. Not software per se but quite likely a software model is possible with sufficient compute.
reply
You're saying Claude had a great time because humans have a great time and it might be possible to model humans in software?
reply
I'm saying that Claude being software is not a definitive argument against Claude having subjective experience, because it might be possible in principal to model humans in software.

Pointing out that Claude lacks internal temporality, a observe/check/act loop, memory, non-virtual experience and therefore can't have a great time would be a much sounder argument.

reply
What’s the subjective experience of gradient descent? Bubble sort? Does ‘y’ feel left out all by its lonesome in y = ax + b?
reply
What's the subjective experience of a neuron? Action potential? Does a calcium ion feel left out by its lonesome in the voltage-gated channel?
reply
> You do know that humans also have a physical substrate?

Lmao

Edit, because this is mean without context: Your comment is essentially the following meme:

> Person who has never worked with anything but computers in their lives: 'Hmm, this brain looks an awful lot like a computer.'

reply
It is true that I am not a neuroscientist but I don’t think that the substrate being software vs chemical is a priori a reason to rule out subjectivity. I think there are other things missing from the current LLMs, (particularly time, inference time chemical feedbacks or electromagnetic feed backs, continuous training, memory, non linguistic thought, etc.), but not the deterministic and formalizable nature of the system. I would not be surprised if something made of software running on some sort of manufactured computation devices did have subjectivity in the future.
reply
You're leaving out the most important bit, which is consciousness, and this is harder to crack than inventing time machines ^^. At least time machines are amenable to science and we kinda have a vague idea of what time is. Consciousness OTOH, is so fundamentally subjective that we can't do science on it by definition.

Of course this is only a problem if consciousness is a significant part of being intelligent, but we don't really know yet.

reply
This is just a bunch of nerd shit sophistry being used to equivocate humans with software. That's a bad take, Claude's a program, it doesn't have feelings no matter what the weird Bay Area sex cult tells us.
reply
I don't think Claude has feelings, but not because it's software, but because it's too simply constructed to capture subjectivity (tho that's a tough claim as we haven't got a precise idea of what subjectivity nor of what is required for it to emerge).
reply
Well you don't know any of that so I'm not sure why you're getting so worked up about it ? It's just software? What does that have to do with anything? You don't understand the software or the human brain anywhere near enough to actually make that statement confidently.
reply
What makes you think I'm worked up? I think you're worked up.

> It's just software?

This but unironically.

reply