Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.


You can hook computer randomness up to truly random* quantum processes with fairly simple specialized chips. Building your argument on such an easily avoided technical detail isn’t wise, because the question can very easily just be asked for a computer that does have access to a source of true randomness. Then it can be nondeterministic-- so what does that have to do with its consciousness or lack thereof?
* unless the entire universe is secretly deterministic, I guess.
I know.
I’m not building my argument solely on this, but maybe I’m being unclear, so I apologize.
Let’s do exactly what you propose; now we pass a seed to the LLM generated from a true hardware-based random number generator. That doesn’t change anything about the LLM itself: it’s still deterministic. I don’t think it’s reasonable to claim that a deterministic algorithm can be conscious, and I think there are other factors as well (the fact that it doesn’t exist continuously, it exists for brief periods simultaneously in thousands/millions of instances at once, the fact that it is static and unchanging unless re-trained, etc) which all paint a pretty clear picture that it cannot have consciousness.