Now we have this software that's specifically designed to mimic humans, and mistaking it for real intelligence or consciousness can easily be disastrous. It's very important that we not anthropomorphize it, but we are catastrophically bad at NOT doing that.
Even our language has had a lot of computer anthropomorphism baked into it ("my phone died!", "this laptop is fussy", "the computer is sleeping", "it's thinking"), and it's not easy to excise that routine anthropomorphism from the way we talk about LLMs.
I don't want an LLM to write as if it were a person because it's definitely easier and more reliable to cut that problem off at the root, as much as possible, rather than to just try to willpower my way out of my human tendency to anthropomorphize inanimate objects.
I'll grant that LLMs talk like this because they're trained on human writing. It may not be possible to get them to not do that. But if it can't be fixed, it's just another thing to put on the "reasons this is all an incredibly stupid idea" pile.
You seem to have something against the clankers getting all uppity. And you are welcome to your opinion on whether we have some moral obligation to be nice to them. But if you can solve a real problem with a tool. Is it worth your time to complain about semantics?
Do you get upset when your screwdriver is the wrong color, or has branding that isn’t quite your aesthetic?
If Claude uses I to refer to itself, do you start philosophical arguments with it?
Mildly related tangent. Fable started using my first name today and plastered it all over my docs. “Peddling said this, so based on that I did this.” That did bother me. I told it to just generically call me the user or human. Maybe I’m a bit of a hypocrite here?
Nice attempt at a “aha, gotcha!” comment, but sadly you’re too off-mark for it to work.
> Claude predicts the next token of the predominantly human training input, and humans use "I".
This is inconsequential. It could very well be programmed to not assume such a personified stance, and yet here we are. Nothing you do makes it drop this ridiculous facade. It’s intentional, not a byproduct.
On it's own a model is just an inert set of data structures.
I could ask you the same. Are you trying to say AIs cannot be made to prefer behaving in certain ways? Because if so, I’ve got a bridge to sell you.