Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.
Philosophy is one of my hobbies and consciousness one of my fascinations. Respectfully, doing “research” by skimming the wikipedia article would be a waste of our time; as would responding to any particular definition and arguing over the individual words people have used in summaries of the topic. So I’ll skip that phase of the convo.
The fundamental problem with measuring consciousness is that it’s an internal state (a “qualia”*). It is fundamentally an experience, something that exists only as a concept in your mind. This makes it immeasurable.
That’s quite the claim, so I’ll provide a smaller concrete example: color. Obviously you can measure the frequency of a photon and say “ah yes, 700nm, that photon is red”. But strictly speaking, the photon isn’t red, it just causes you to percieve “red”; it has a wavelength which triggers your eyes and brain to produce the subjective experience of the color red. That subjective experience of color is a qualia, and it is not directly measurable; at best you can measure the phenomenon that causes that qualia in you, and assume that that phenomenon would cause the same qualia in someone else when they percieve that photon. Technically, you can’t be sure that this assumption is true-- this leads to the “Inverted Spectrum” thought experiment (another great wiki page if you prefer their explanations to mine), where someone’s subjective experience of color as it relates to the frequency of light could be entirely different to your own.
Anyways, you cannot prove the existence of nonexistence of such an internal experience, and consciousness belongs to this category of qualia. You know that you are conscious because you experience being conscious, not because you can prove it by looking at what you do. You can’t even be sure that I’m conscious, even if you met me in real life; you can’t prove that I am actually thinking, feeling, understanding, knowing, or realizing anything, because you cannot be me. You can only assume that I am doing those things because you observe me doing stuff in physical reality that’s consistent with the way the only entity you can be sure is conscious (you) is acting, and assuming that since I’m made of the same stuff as you and I act kind of like you do that I am probably conscious.
If you could actually prove that it is impossible for a machine to be conscious without that same argument applying to humans, then the philosophy community of the last several millenia would praise you as their messiah. I am interested to see what your argument would be if you want to give it a shot though-- no harm in trying.
* Like “data”/“datum”, technically the singular form is “quale”, but I’m gonna be real, nobody ever says that. Anyways if you like reading wikipedia pages about philosophy, “qualia” is a good one!
How is red a subjective experience? We can all experience red things, at least, all of us with functioning eyes. What about that is subjective? How is color not directly measurable? Color is very easy to measure, we can even assign it values, like (r,g,b). If you see something red, you have already measured it to have the values (>0,0,0). I don’t know what the term “internal experience” even means. Experience is just something that happens to something else. A rock experiences erosion in the rain. I am experiencing tiredness right now. To say something experiences something is to just say X is happening to Y. I don’t see how it is meaningful to assign adjectives like “internal” or “external” to it. I mean, if the adjective was meaningful, then would it not imply that you are implicitly contrasting “internal experience” with “external experience”? What on earth would external experience be? If you cannot tell me what external experience is, then the adjective “internal” is contrasting it with nothing at all, so it is a useless adjective.
If you don’t understand what I’m trying to explain about qualia or that there is a philosophical distinction between the physical world and your perception, just read the wikipedia article on qualia or any similar introductory material to the philosophy of the mind. It answers like 90% of your questions.
Some specific answers though:
RGB is measuring/defining proportions of different wavelengths of light, even if its goal is to describe that light in a way that is supposed to elicit a particular subjective experience in the viewer. Color spaces are a MASSIVE rabbit hole so I would suggest using the simpler example of how an individual photon has a wavelength that makes us percieve the subjective experience of red, rather than being red itself. Although actually, bringing up RGB gives me an idea for something to point out: qualia and the physical world can “desync”, which is evidence they are different. If you see light with a wavelength of ~600nm, such as that produced by a sodium lamp or banana, you will percieve it as yellow. But that subjective experience of yellow is also triggered by seeing both ~700nm and ~500nm wavelengths of light simultaneously, which you would individually percieve as red and green respectively. This is how your computer screen does it. ||I guess technically you could argue the cone activations in your eye end up the same, so this may be a bad example… regardless, the point is that something like a taste or smell or color has no physical meaning, they are experiences which are caused by physical phenomena rather than being the physical phenomena themselves.||
I am using “internal experience” to mean the subjective way that you percieve the world. If I just used “experience” you could use it more broadly in your sense of “X is happening to you”, which is not what I mean. I guess you could call those things happening in the physical world an “external experience” but I agree, that is a bit confusing and is not my intention. I am using “internal” to make a more specific compound term, not really to contrast it with “external”. But if you are using the word “experience” to mean “C is happening to you” then yes, the external experience is the thing that is physically happening and the internal experience is your perception of it happening to you.
Proof?
We knew about colors long before anyone knew what a “wavelength of light” is. I can tell something is red without needing to measure its photons. There are correlations between red, green, and blue, but they are not exact. Monitors do a lot of weird things with colors and so it is just false to state that there is a direct equivalence to color values and wavelengths of light that the monitor will actually emit.
How do I perceive the world “subjectively”? What does that even mean? Is it possible to perceive the world “objectively”?
So all you mean by “subjective experience” is that the things are happening to me specifically? So, if thing happens to another thing, and one of those things is a subject, then it is subjective? That is a strange way to use the word “subjective.” If I eat a sandwich, is that subjective eating?
What do you mean “proof”? Proof that the field of philosophy considers there to be a distinction? I pointed you to a great resource to learn about this, the proof that philosophers think there is a distinction and the details of how and why they believe that (and common arguments against it if that’s your jam!) are RIGHT THERE in the link I provided. This is not some crackpot theory I am trying to prove to you in a lemmy thread, I am just explaining philosophy of mind 101. Like, this is literally related to “I think, therefore I am”. If you disagree with philosophy in general then I’m not going to spend several hours justifying the entire field of philosophy to you; I’ve pointed you in the right direction, if you want to learn more about it then just read the basics, they can explain it better than I can and it’s much less argumentative that way. Seriously, I recommend it, it’s a good time and it’s a fun way to explore the nature of your mind.
lot of people believe something therefore it’s true
i am very intelligent
This is why Chalmerites like yourself are subhumans bugs. You have no brains. You are entirely incapable of conscious thought.
It is literally physically impossible for you to ever think about anything anyone ever says. Your brain just absorbs something that someone told you as a fact. When asked to justify it, every Chalermite bug is shocked at the very idea someone does dares question the eternal wisdom! To rationalize it, they conclude: the only possible way someone disagrees is that they just don’t understand the great wisdom of our lord and savior David Chalmers! They must just be an uneducated heathen who has not seen the light of the scriptures!
Yeah, an idiotic and completely circular statement, because “I” is both in the premise and the conclusion, and so using it to prove that “I” (the self) is a priori is the highest level of sophistry.
If “philosophy” = Chalmerite brainrot, then sure, I oppose philosophy.
Holy shit fuck off, I’m done being cordial. You haven’t had a cogent reaction to a single thought I’ve had. I’ve been nothing but patient as over and over you failed to recognize basic common terms or even attempt to conceptualize my many helpful examples (well, I guess I could have given more, but you don’t really deserve it so I won’t feel too bad) so that you could understand the subject I’m talking about. I have never asked you to agree with me, or asserted that the things I am discussing are unquestionably true, especially solely due to some philosophical authority; the reason I have resorted to pointing you to literal wikipedia articles as philosophy 101 content is because you have demonstrated a complete lack of understanding of the subject matter. How could you possibly hope to be correct if you cannot understand the argument that is being made?
But you aren’t here to be correct, or to learn, or to reach a greater understanding through discussion, or to explore the beauty of your mind-- because yours is rather ugly, isn’t it? You’re here to troll people on social media to feel good about yourself. If you don’t like philosophy, here’s some pop psychology-- people tend to assume others are like them in some fundamental ways. I have spent this entire thread trying to believe you are here to learn or teach, not to troll; while you have apparently spent it assuming anyone who disagrees with you must be brainwashed by Big Psych. FYI I have made an explicit effort to avoid learning about what Philosophers™ think (legitimately who the fuck is David Chalmers?), because I prefer to avoid their influence when practicing philosophy myself; and yet the things I am talking about here are easily independently discoverable by me, someone with little to no formal training in the subject who actively avoids duplicating others’ work where possible. Honestly at this point you’re starting to make me think you might not have an internal subjective experience, because I think if I experienced what it was to be you, my soul would combust out of embarrassment.
What are you talking about, “done being cordial,” “nothing but patient,” “spent the entire thread”? You literally replied to me like 2 times before this. You hallucinating some long-running conversation or something? LOL
You say, “I have never asked you to agree with me, or asserted that the things I am discussing are unquestionably true,” but then you insist I must be an entirely ignorant moron who simply disagrees with you because I don’t know anything about the topic… if you believe people can understand the topic and disagree with you… then why do you not act that way in practice?
Not a single neuron in your brain ever fired when I asked you to explain why you believe what you do; you immediately just jumped to “this person questioned the sacred scriptures! They must not understand anything!” And just posted a rant explaining how I must not know anything at all for daring to disagree and not automatically buy into your claims.
Yeah, and so you mindlessly absorb popular ideas without even knowing who they are from. The idea of “subjective experience” was popularized by Chalmers, who used it as his basis for his framework of “subjective experience” being “consciousness.” The term itself he didn’t invent, he borrowed it from Nagel, and so the term never existed in the literature until 1974.
Apparently, according to you, philosophy did not exist until 1974, and so me, disagreeing with a stupid paper, is equivalent to me denying all of philosophy!
You also say, “You haven’t had a cogent reaction to a single thought I’ve had,” but what cogent point have you even attempted to make, other than claiming that I must fail to understand your genius for not automatically agreeing with you?
Almost none of this is relevant to the discussion here – I’m not interested in philosophical discussions of consciousness when it comes to the question of whether an LLM is conscious. Though I’m already aware of most of what you said here, and the philosophy of consciousness is interesting in general to me!
Quick nitpick: I never said it’s impossible for a machine to be conscious, I said it’s impossible for an LLM to be conscious. We may well invent something new in the future that qualifies as both “machine” and “conscious,” but an LLM is not that thing.
When people ask “is an LLM conscious?” I assume they’re asking from a practical, scientific perspective – does the LLM experience the world in a similar way to the way I (and presumably, others) do? If that is the question, the various definitions I already posted are what we should be using to answer. Since an LLM is a deterministic algorithm whose only purpose is to generate a plausible response to input based on its training data, it cannot possibly think, or have feelings. It does not even exist continuously in time, and it is fixed and unchanging, unable to incorporate any new information at all. We don’t actually need to measure or test anything here; that an LLM lacks all of these things demonstrates that it’s not possible for it to be conscious.