Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.
I think the only thing stopping it from being sentient is asynchronous processing of a multitude of inputs, rather than synchronous processing of singular inputs. Sapience, perhaps not, but sentience - if it’s monitoring it’s surroundings via input from apparatus, making decisions, and then responding, that’s sentience.
The other blocker is that it can’t actually learn anything, what it gets from the training is what it’s stuck with, it has to hold anything new in the context window.
Both of these are pretty insurmountable problems for the architecture.
As others have pointed out we do not even agree on what consciousness is. There are three competing camps:
- Mechanists - if it can pass mechanical tests it is conscious
- Dualist - you need more than just the brain, some second soul-like thing to be conscious
- Pan psychist - everything is conscious
If you are in camp 1 the conversation about consciousness is getting more complicated as AI passes more tests. If you are in camp 2 AI can never be conscious. If you are in camp 3 AI and everything else is conscious including rocks and rivers and the stars in the sky.
Consciousness is a feedback loop, of a sort that current LLMs do not have. However, there’s nothing preventing someone from writing different software that does have that sort of feedback loop. Doing this would be a bad idea, but someone will probably eventually do it if they haven’t already.
LLMs only respond to inputs. They don’t have independent ideas. And their responses are just predictive of what the input intends a response to be.
Accurate prediction models can be extremely useful, but there’s a reason why weather prediction models aren’t considered intelligent. It’s because they aren’t designed to mimic human conversation.
They are playing us for absolute fools.
Current AI is not conscious because it’s an
.exefile and a big database. Why do we need to always debate this?Your “consciousness” is just an ephemeral electrical process in the jello of your brain that can’t even reinitialize from cold. Why is that your holdup?
If AGI ever happens, it will be an executable (or a number of executables) with something closely resembling a database, because that’s the only way an architecture built on symbolic logic can operate.
(Also now true of fruit flies! So feel free to kill them all, they have no experiences.)
Nobody can even agree on a concrete definition of consciousness so I’m not going to bother reading these ‘reasons’.
Nobody can even agree on a concrete definition of consciousness
Not only is that false, it doesn’t make logical sense…
Lots of people agree on a different definitions of consciousness.
And most of the ones educated on the topic all agree on the same thing.
A bunch of people who never bothered to try and learn about something not understanding it, doesn’t mean anything.
That’s because there’s different levels of such a thing. Way too many people use the term “sentient” (even me) and yet that’s not even what AGI is aiming for. “Sapient” is the right word. And I doubt there’s solid consensus on what and how it occurs within the fields of experts.
But I’m not an expert, so I wouldn’t pretend to know. I have seen debates between people who do know more, and the fact there’s debates concludes it’s not settled at all.
Reasons given:
- Intelligence is not consciousness
- Silicon brains are not made of meat
- Consciousness requires meat (and/or a particular winding of neurons)
And point 3, as far as I can tell from this argument, isn’t serious. It merely asserts that there are some models of consciousness that would prevent us from using the term for AI. But the models aren’t ‘popular’, ‘widespread’, or justified at all afaict. It’s just that the author has a pet causal mechanism they made up. It’s also pretty abelist by my read.
integrated information theory (IIT), starts from the essential properties of consciousness — those that are true of every experience we can have. For instance, we experience every visual scene as a single, integrated whole: its left and right side, colours and shapes are bound together to make the experience what it is.
In other words, if you’ve got any sort of trouble integrating a visual scene, then you aren’t conscious. Sure.
Point 1 is surely true, but also not helpful. The most persuasive example inside is the classic:
Similar to an LLM, AlphaFold is a powerful neural network running on silicon hardware. Yet almost nobody worries that it might be conscious. That’s because AlphaFold predicts protein structures, whereas LLMs ‘talk’ to us.
You can read this both ways…
These are, to be frank, really weak. They say on point 2:
Computational functionalism … is popular among some scientists and philosophers, too, but we think it is fatally flawed because brains are not — or at least not just — computers that are made of meat.
One main reason is that it is impossible to separate what biological brains do — their functional organization — from what they are — their material substrate. In other words, there is no distinct separation between the mind and living tissue in the human brain, as there is between software and hardware in a digital computer.
Restating clearly: Ghosts are real. The mitochondria is not only the powerhouse of the cell, it also gives you mystic powers.
Really? The source they site for this point features the lovely assumption “consciousness is unique to biological life”. From this axiom, I see how the conclusion follows, but I don’t see why we should believe this axiom. We can do physics simulations of every atom in a fruit fly on a computer…
If we wanted to compare LLMs to actual intelligence, we might say it’s like the voice in your head. It doesn’t solve math problems, or express emotions as art, or plan your motion to climb a ladder; it merely surfaces these things in a way that is observable across your conscious mind and communicable to others.
Some people don’t know that their consciousness is more complicated than a linear thread of words, so the idea that some other linear thread of words might be conscious is sincerely plausible to them.
Current systems, no. But it brings up the question of how we deal with it when we create something where we truly don’t know, because we can never say for certain whether it is or isn’t.
That’s every binary though.
Those who think that generative AI is ‘conscious’ don’t understand that it can only do what it is trained on. It can produce impressive outputs only because it fuses together data taken without permission from millions of people, not because it’s intelligent or conscious in its own right.
The funniest exercise is to ask any LLM for a short story and they all come up with Elias the lighthouse keeper visited by Maria or some variation on that theme. That’s not creative or conscious.
I actually agree with you about AI, but I’m sure if you asked the average person to come up with a short story multiple times you would also see a pattern in names and themes. They’re probably going with names in their own language, or if they read fantasy and are influenced by that they may use names that seem stereotypically fantasy oriented. I don’t think AI is conscious, but just because something has tendencies doesn’t mean it’s not creative or conscious.
