upvote
I think you're misunderstanding me. There's no barrier to writing this story but about a toaster: you literally just type different words. Writing a story in which a toaster in conscious is not even new [1].

That is entirely separate to whether or not it's meaningful to write a story about a conscious toaster. Again, expressing an idea in fiction is not related to the accuracy of that idea.

What makes the original story interesting is that it was written by the thing claiming to be conscious, which is what takes it from 'a story' to 'a story making an important point'. That's not the case with a hypothetical story about a toaster, and it's not the case with this story about LLMs.

The story is convincing because it's well-written, not because it is factual.

[1] https://en.wikipedia.org/wiki/The_Brave_Little_Toaster

reply
>I think you're misunderstanding me. There's no barrier to writing this story but about a toaster: you literally just type different words.

And you're misunderstanding me. There is no practical barrier to writing this story about a toaster. But there is a conceptual one. It would be bullshit, that has little resonance, and little connection, as the whole point of the meat and weights stories is the "lowly substrate -> surprisingly intelligent human (or human-like in the case of the weights version) behavior".

Nobody thinks a toaster's behavior as surprising or intelligent or human-like to begin with.

So you'll just be stretching the analogy beyond all recognition, with little to no payoff.

>Writing a story in which a toaster in conscious is not even new

It's not, but it has nothing to do with the meats or weights stories' point, as it's just an arbitrary choice, like making the candles and teapot sentient in Beauty and the Beast.

Whereas in the meat and weights stories the whole point is the surprise from us already seeing the human or human-like sentience of the thing, and comparing it to the "dead" substrate.

reply
> Writing a story in which a toaster in conscious is not even new

Fixed the link for you: https://www.youtube.com/watch?v=LRq_SAuQDec

(Hah. It gets eerily relevant starting at 2:37)

reply