Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.
They can learn and change over time, that’s just not enabled. The services that offer them want a reliable, reproducible, controllable experience. There’s zero reason they can’t continue to change through usage, other than it’s a conscious decision not to enable that functionality.
That’s why they can only be conscious when they train using new data, and run asynchronously with continual input - the same way we do.
Even if we could update an LLM’s weights continuously, the algorithm is still deterministic, like all computer algorithms. There is no evidence that humans are deterministic (or a “finite state machine”) in any way. So I don’t think such a dynamically-updating LLM could be conscious, either.
It is my personal belief that all life is deterministic. It’s the only plausible explanation for instinctual behavior - like monarch butterflies returning to their breeding grounds they’ve never been to. Or people yawning because others yawn. These aren’t conscious decisions, they’re peeks at the deterministic coding that life operates upon.
I don’t think you understand what “deterministic” means.
I very much do. It means that given the same inputs to a system, you can expect the same output. I believe that to be one hundred percent the incontrovertible reality of life. The problem is it is not a testable theory, because the input includes the state of the system prior the new input. You can never recover that information, so there is no way to put it through and see if you will get that same output. Spacetime coordinates and the position of the cosmos themselves are all variables in this deterministic function, but it’s still deterministic.
OK, that’s great. So if I understand you correctly, it seems like you’re admitting that not only do you have no empirical evidence for your position, you don’t believe you’ll ever be able to test it. This seems like a weak position to hold, almost akin to a faith-based religious position.
As I’ve said, I think the existence of instinctual behavior qualifies as empirical evidence for my theory. I don’t believe it on a whim. Another example is twins, separated at birth, yet growing up to have nearly identical preferences and lives. Making choices reflecting the deterministic coding of their internal decision structure, which they largely share outside of nominal differences resulting from environment. That is rather strong evidence, I feel.
How have you ruled out other explanations for instinctual behavior? For example, there is a body of scientific work which offers evidence that instincts are passed down through genetics, a mechanism which doesn’t require that the brain be deterministic. What are the scientists studying this area getting wrong?
What about twins that are separated at birth but grow up to be different? It seems that the existence of even one such pair of twins would invalidate your claims, given how fundamental this would be to the operation of the brain.
Because we’re talking about the same thing in a different language. "Genetics* only mean the instructions used to build the structure of our intelligence. They’re not wrong at all, our determination nature is the result of the structure of our neurons which has a fundamental configuration determined by genetics.
No, it doesn’t invalidate it because the twins could be fraternal, having separate DNA, or that could have had such extreme differences in environment that it drastically changed the DNA from the shared base. Excluding those, though, and you can see the deterministic nature of life shining through.
A computer algorithm can absolutely be non deterministic, pick your language and run random.rand()
There is a whole class of such algorithms https://en.wikipedia.org/wiki/Nondeterministic_Turing_machine
But I don’t see how it makes a difference, even deterministic algorithms can produce infinite complexity, eg linear neural networks are proven to be able to compute any computable function, or the Mandelbrot set which is produced from a single recurrent statement but encodes a space of infinite complexity
Maybe your point is to say that a brain is performing a non computable function…but since your brain is computing that function…is that a counter example?
How are the numbers generated by random.rand() made?
Also, NTMs are not algorithms, they’re models of computation in theoretical computer science.
My point is that for brains, it’s not possible to recreate the exact same inputs to be able to test whether the brain produces the same output. So it’s literally not possible for brains to be deterministic.
You can hook computer randomness up to truly random* quantum processes with fairly simple specialized chips. Building your argument on such an easily avoided technical detail isn’t wise, because the question can very easily just be asked for a computer that does have access to a source of true randomness. Then it can be nondeterministic-- so what does that have to do with its consciousness or lack thereof?
* unless the entire universe is secretly deterministic, I guess.
I know.
I’m not building my argument solely on this, but maybe I’m being unclear, so I apologize.
Let’s do exactly what you propose; now we pass a seed to the LLM generated from a true hardware-based random number generator. That doesn’t change anything about the LLM itself: it’s still deterministic. I don’t think it’s reasonable to claim that a deterministic algorithm can be conscious, and I think there are other factors as well (the fact that it doesn’t exist continuously, it exists for brief periods simultaneously in thousands/millions of instances at once, the fact that it is static and unchanging unless re-trained, etc) which all paint a pretty clear picture that it cannot have consciousness.
Yet.
No, not ever.
That is a bold statement. It’s just capturing all considerable information in a set coordinates of spacetime. How hard could it be? Very. But very hard is not impossible.