I do not believe current AI or LLMs are conscious, but there is no proof one way or another that they can or cannot be. The paper authors are making up their own definitions and building an argument from them
I, and apparently many others, don’t think it would be any useful to describe the mathematical properties of an AI as consciousness. To me it is inherently a way to describe the “experience” arising from physical processes in biological beings as ourselves.
That’s what the argument comes down to for me. Could an LLM “fall unconscious”?