This, too, is in the article.
reply"The fact that LLMs lack subjective experience has little bearing on the question of whether LLMs might be useful tools or have significant economic impact."
Without saying that I think LLMs are alive, I do think it matters. I have personally been cruel to an LLM in ways that would make me ashamed if I suddenly understand that it had feelings.
replySame, I'm working on a plugin called "better-messages" to nudge me towards better behavior for my own sake. It seems to be model dependent if such words improve or degrade performance, I have seen it go both ways.
replyWhat do we do when someone wants to marry their Ai companion?
replyIf it produces words of love, those that stir emotion and make the human happy, should we let them live on in a delusion that the machine also feels love? Does the machine have different preferences? Do they get in fights?
Should such a machine have the same legal rights? Do they get more tax deductions? Can they adopt a human?
I think it important that we humans have some rational discussion on these Ai tools that are really quite good at simulating emotions and providing frictionless relationships. If you though social media was bad for people...