Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.


I know.
I’m not building my argument solely on this, but maybe I’m being unclear, so I apologize.
Let’s do exactly what you propose; now we pass a seed to the LLM generated from a true hardware-based random number generator. That doesn’t change anything about the LLM itself: it’s still deterministic. I don’t think it’s reasonable to claim that a deterministic algorithm can be conscious, and I think there are other factors as well (the fact that it doesn’t exist continuously, it exists for brief periods simultaneously in thousands/millions of instances at once, the fact that it is static and unchanging unless re-trained, etc) which all paint a pretty clear picture that it cannot have consciousness.