What if genetic memory, multigenerational conditioning, life-long patterning and conditioning, experienced in a body, combined with forces and processes not yet detected nor explained, cannot quite fit in a sliver of modeling?
"We must not consider consciousness as all too important because what matters is human flourishing and human rights."
And some of
"Even if we suddenly all agree an LLM is conscious it wouldn't and shouldn't influence us very much"
While acknowledging that some people will change their lives, the way some people like myself won't eat octopus or apes because it is probably more like murdering a sentient creature.
And oh by the way you cannot murder a copyable individual anyway. Did you read Enders Game?
>And oh by the way you cannot murder a copyable individual anyway.
I think for many people the concern is not so much about violating the desire to live that a conscious software entity might (or might not!) have, but about the subjective experience of suffering it might undergo.