If your argument is that matter brings about consciousness somehow and therefore LLMs can in principle be conscious, that's as good as claiming the opposite. There's no experiment that can falsify either.
As a being that knows what consciousness is intuitively, you already know that a graphics card is most likely not conscious.
I would say that it is more likely than not that a graphics card exhibits some form of consciousness. But I am a panpsychist, I believe an individual atom has some form of consciousness.
Ultimately consciousness has to come from somewhere, and it being a fundamental property of matter is a good a place as any.
Fair enough point. But then I guess you'd also say that a piece of silicon or sand exhibits some form of consciousness. I don't think that's what people mean when they talk about the potential of LLMs (the algorithm) being conscious or somehow developing consciousness?