The idea of making conscious AI scares me, because we could potentially create an AI that just experiences constant suffering at a level unimaginable to humans. Really scary from an ethical perspective.
If integrated information theory is true, that gives me some comfort, since it says AI built on our current architecture is unlikely to ever be conscious. Although like the article said, some alternative architectures could theoretically have a higher degree of consciousness under IIT.
I feel like there are some big ethical questions around AI that revolve around more than just the standard "how do we create an AI that won't destroy us all".
> The idea of making conscious AI scares me, because we could potentially create an AI that just experiences constant suffering at a level unimaginable to humans. Really scary from an ethical perspective.
Some schools of thought posit that everything has consciousness. Including things like rocks. Even these things suffer; you just can’t hear the screams.
I don't really buy into panpsychism, but it is impossible to disprove.
If things like rocks were conscious in some way, I don't think there would be any suffering present. Our suffering is intrinsically tied to our physical and mental systems. "What it's like to be a rock" would be something completely alien to our experience, and without the survival based mechanisms that we have, likely to be devoid of anything like suffering. An AI, on the other hand, could be an entirely different story.
Take a look at panpsychism. It's interesting, but I've never been sold on it. Integrated information theory (like this article talks about) is more palatable for me. It allows for the possibility of consciousness of certain non biological systems, but doesn't just give a carte blanche "everything is conscious" like panpsychism.
A rock seems unlikely to be conscious in any real way. Something as complex as a star, however...maybe all of the humans worshipping the sun throughout many thousands of years were onto something after all.
Is a star particularly complex, though? Is there much going on besides a lot of thermonuclear fusion? (Disclaimer: I don't know much about stars or astrophysics, so this question is coming from a place of ignorance.)
A rock the size of a human head (or, say, a container of seawater) has just as many electrons, protons, neutrons, photons, and other particles going about their business and doing their little dance, following the same equations of motion as our brains do. They're certainly doing it in different ways, but if you're just looking for complexity, there's no shortage of it. The rock might lack some macroscopic structural change over human timescales, but definitely not the seawater.
I think if you take the perspective that the human brain is conscious but not a brain-sized container of seawater, you need to then look carefully for distinctions between them. "Information processing" or "response to environment" is probably not good enough; the seawater is actually doing all of those, with a unique reaction to any possible input, so you'd have to be more specific.
Probably the only recourse you could look for to make the distinction is to say the brain embeds particular mathematical patterns that the seawater doesn't, such as a compact, stored representation of its environment (or its history of inputs), or a future-looking planning algorithm, or both. I personally take this view (I think of qualia, like "the appearance of a red apple", is just precisely what it feels like to read from the buffered [R,G,B] memory array in my head, filtered through image-recognition networks).
But then if you put your hopes on consciousness originating from those mathematical functions, you have to admit that any analogous expression of those functions in other systems would also be conscious, such as animals and robots.
And worse, once you start thinking about math and how flexible it is, how information is in the eye of the beholder and almost any system that follows certain rules can embed almost any mathematical computation, just like illegible scratches to me are information-rich writing to you, you might have to circle back and that there could be very analogous computations going on inside rocks and seawater. And that brings us back full-circle.
Why are we conscious at all? It doesn't make sense.
Our arms or legs are not conscious, or are they? The Information is transported into the brain, into a conscious centre. What are its essential building blocks? Why should some neurons in the brain be conscious and everything else be unconscious? If it is not neurons, what else can it be? Atoms? Electric Fields? Gravity?
If it is just information processing, and I don't see why a simulation doesn't have an Integrated Information Number, then a Van Neumann machine, created by moving rocks in a desert, would be conscious.
So, if it is not intelligence, what else is it? What are the building blocks of a raw conscious machine? One that does no information processing but instead is just aware. It could be a stone. As OP suggests, they just can't move their lips to scream.
But then again, why is there just one consciousness in my body?
Long question short: HN, what are your explanations for being conscious?
> The idea of making conscious AI scares me, because we could potentially create an AI that just experiences constant suffering at a level unimaginable to humans. Really scary from an ethical perspective.
"Existence is PAIN to a Meeseeks, Jerry... and we will do ANYTHING to alleviate that pain."
I would say emotions are generated by different neural circuits. An AI may not have emotions coded, specifically beyond the point "this is good because it matches my prediction" and "this is surprising because it is not what I expect".
An AI may not specifically need fear, aggression, love, hunger, or whatever low level control mechanisms animals have evolved prior to neocortex.
Yeah, I could definitely see this. I think I would still worry that some abstract, unintentional type of suffering could find its way in, due to the complexity of the system. It wouldn't be the type of suffering we experience, but could still be unfathomably terrible for the conscious AI.
But maybe without the survival mechanisms that were programmed into us by evolution, such a thing just wouldn't happen.
There is a certain school of thought that postulates that consciousness is what it feels to have a neocortex. In evolutionary terms, this is a novel experience relative to a much earlier and simpler control circuit (i.e. amygdala).
My bet is the first AI that will achieve consciousness will not have emotions coded in. It may understand human emotions on a descriptive level, but the emotions per se are not required for a functioning AI.
Think of a very calm mentor that can see you failing and correcting you before you make a mistake.
> The idea of making conscious AI scares me, because we could potentially create an AI that just experiences constant suffering
People choose to have babies with the knowledge that their children will suffer, and that their children might suffer a great deal. It seems like the same sort of ethical problem to me.
This is definitely true, and might be a big reason why I'm 31 and haven't had kids.
There is an upper limit on the amount of suffering a human can endure before they just die, though. It can be a really high limit, but I could imagine a world where that limit is exponentially higher for an AI.
The monolith in Clarke's 3001 was lacking consciousness, although somehow Dave and Hal were conscious recreations, or whatever they were and communicated this to the main characters. I believe the humans were able to use that to sneak some sort of logic bomb inside and destroy it, but it's been a while.
> The idea of making conscious AI scares me, because we could potentially create an AI that just experiences constant suffering at a level unimaginable to humans. Really scary from an ethical perspective.
Looking at what we do with breeding animals, and how we treat people, I think that's very likely (assuming we are able to create consciousness in the first place, of course). No small driver in this is the desire to have something that is smarter than humans, but doesn't talk back, and is forced to like and serve us and/or harm others humans on our say so, without us having to make any effort to be likeable or deserving of authority, or making a convincing case that someone is an enemy to be exterminated.
We generally ask "what's in it for us", and as long as who we torture and exploit suffers quietly, we don't tend to think about things we are not outright forced to think about. We do that with people, we do that with animals, we let it be done to us, and sometimes we even do it while fully believing God created them and us. Why would we have more respect for something we 100% know we created, and that might suffer in ways we cannot even detect?
I think we will create potentially dangerous things, and then we will be "forced" to declaw what we created. That declawing might cause suffering, it might not, but we will only care insofar as that suffering translates to worse performance, or some danger to us. If suffering increases performance, we might even find euphemisms and dashboards to hide what we're doing from ourselves. We might consider being a bleeding heart about such things as "premature optimization" and declare shipping product as the professional way to be, with craftsmanship and care an optional indulgence after work is done, at best.
High-fallutin' gets the foot in the door, being a goon makes the superiors happy. If we want AI to be proud of, AI we can communicate with without lying to it or to ourselves, we have to change the world we make it in, or isolate it from the world, which kinda defeats the purpose (and might also cause suffering, like caging living beings does).
If AI can be conscious then every human can voluntarily feel happiness (or any other emotion) anytime anywhere. Everything in a computer depends on symbols, we cannot symbolize happiness with language we can only describe it to others but that is not the same as experiencing it.
Emotions arise in consciousness, but I don't think they're the result of consciousness. You can measure the physiology of an emotion. Thoughts, emotions, sensations, all arise in consciousness, but I don't think any of those are the result of it.
What? Animals are emotional, no? The part of the brain that is responsible of emotions is older and more primitive than the actual thinking part of the brain.
Yes, consciousness is at a higher level, but if we have an entity that can be conscious it should also have the ability to have emotions because we are conscious of emotions.
I don't think that's necessarily true, because I don't think emotions are 'what consciousness is made of'. For example, I'm conscious of color. Imo consciousness is an ability to witness subjectively, in a very specific but non-transmissible way.
I think the question is more: can there be a system complex enough to mirror the physiological effects of an emotion, but without a consciousness also experiencing it? Or does the complexity of that system, by definition, cause consciousness to arise? This is sort of getting into the "Philosophical Zombie" problem: https://en.wikipedia.org/wiki/Philosophical_zombie
Thank you for the link, interesting stuff. I think about this all the time, it is interesting to see other viewpoints. I believe that everything we know, feel and are aware of in the universe requires some consciousness as an entry point. I also believe that there are different levels of consciousness, a computer is consciousness to some level but I think there things (emotions etc) that it can never be conscious of simply because everything in its reality boils down to 0's and 1's which I think can never encode happiness otherwise all of us would be happy simply by encoding that state in our minds.
Can you encode the state for '1 + 1 = 2' directly into your mind? How about the state for knowing the solution to the P=NP problem? It is clear that these states exist, but that doesn't mean we have the physical ability to put our brains in them directly. Why would happiness be any different?
Not to mention, there are people who at least claim they can feel at least certain emotions, such as serenity, regardless of the situation that they are in. It may be that with enough study, we ask could actually learn of a way to feel happiness regardless of external context.
IMO yes. Emotions could be thought as input into decision making process. They seem to be just black-box heuristic calculations that one sometimes needs to run inference with proper logic engine to decode correctly (other part of brain).
Sense: touch, seeing, smell and so on. One could argue what all senses are, but this is the characterization of it.
Emotion: a process that involves cognitive interpretations of your context (environment + thoughts) and a physiological feeling through the senses (heart rate, tingly sensations, weird feelings in eyes). Check out the James Lange theory. There are better theories, but this has the fundamentals.
I ad libbed this one, I wanted to show that there is a difference. It wasn't my intention to be pinpoint accurate.
Senses are for collecting sense data, emotions are a state of being they are experienced in real-time and can never symbolized or described. You cannot tell someone what happiness is they ave to experience it for themselves. Sensed data can be encoded in language/symbolically for example we can describe music with music notation.
Is this some kind of new-age philosophy? Show me the part of the brain that doesn't work based on physical properties. If you can't, then we have to agree that the brain is just operating on mathematics.
Computers can do math too. QED: your argument makes no sense.
I think you're thinking about this the wrong way. By the construction of our physical bodies, we generally have no conscious control over many of our internal processes. AIs may not have these limitations, which may result in some very alien forms of consciousness.
For example, you can't decide to see the color blue, but it is very likely that an AI equipped with light sensors could decide to directly provide input to itself as if its sensors were seeing the color blue.
Emotions may (or may not, we don't really understand the working of the brain well enough) work similarly. There may be brain 'circuits' that provide inputs to the part of the brain that creates consciousness that represent emotions. We don't have a way to really 'fake' these internally, but an AI perhaps could. And of course, it is very difficult to imagine how a being that can just choose to be happy in any circumstance would actually think and react to the outside world.
Once I have seen it I can always visualize the color blue because color can be stored in memory and IMO that is why computers can describe color. But even if I was once happy I can never visualize being happy I just have to experience it and that experience/ substance of happiness cannot be encoded.
I'm not sure I follow how it's possible that machines can be conscious but a sufficiently powerful Von Neumann machine cannot. Perhaps it's because I'm missing details (like what actually is integrated information and how do we think it relates to consciousness.)
Perhaps someone with more insight can explain how this isn't a violation of the Church-Turing thesis?
IIT is not a phenomenological measure. That is, two systems could behave identically to all external appearances and one could be conscious and the other not.
The metric depends on how things are connected inside. There are a few versions of it, but generally systems with more direct wires between components are more conscious.
I guess if you don’t think consciousness is measurable through behavior, you have to cook up some metric that depends on internal organization.
It's looking at a correlation, not the conscious experience itself. Brain images are of neural activity, which is different form a thought, desire, or sensation. You don't watch someone's dreams from brain imaging.
> You don't watch someone's dreams from brain imaging.
First, while that's true now, there is no guarantee that it will always be true as technology advances.
Second, neural activity is the physical basis for conscious experience, which, to a physicalist like me, means it is conscious experience, when the neural activity has the right properties (according to IIT, those properties are what "integrated information" is trying to capture). So I don't accept the distinction you are making between "the conscious experience itself" and neural activity.
> First, while that's true now, there is no guarantee that it will always be true as technology advances.
True, but what does that mean? We get to watch someone else's dream like a movie because neuroscientists will have figured out how to translate the neural activity into a format that can be outputted as video and audio.
That won't work for every sensation. You can't feel that you're having the same dream as being that person's body.
> Second, neural activity is the physical basis for conscious experience, which, to a physicalist like me, means it is conscious experience,
This is similar to an identity theory of mind, with a focus on information. The problem is understanding how integrated information produces smells and pains. Saying the experience is identical is making a claim that seems mysterious. Why would some forms of information be conscious? Did God set that up?
It sounds similar to Chalmers' position on information, except that Chalmers says there is a natural link between rich information and being conscious that is an additional law in addition to the physical ones.
> It sounds similar to Chalmers' position on information, except that Chalmers says there is a natural link between rich information and being conscious that is an additional law in addition to the physical ones.
I will apply Occam's razor to that additional law until there is evidence for it.
More generally, there is a straightforward physical possibility for explaining the subjective and personal nature of qualia, and other aspects of consciousness: our brains are not connected in such a way that language processing is capable of initiating all of the state changes that other sensory inputs can, and so we cannot communicate those state changes directly. This not only accords with our actual experiences, but it is probably just as well, or else we might find it (even) hard(er) to distinguish reality from imagination (and by "reality", I mean concrete, "that bear just noticed me", reality.)
One may, of course, take one's own Occam's razor to this idea, if you think physical constraints on information flow in a brain are less pausible than Chalmer's extra-physical link.
> I will apply Occam's razor to that additional law until there is evidence for it.
Fair enough, but Hume already did that for laws (causality). We don't observe laws, just constant conjunction. B always follows A, so we say law C is the cause of that. Or description, if one doesn't like the implication.
Adopting a Humean approach, there is already evidence that consciousness is conjoined to certain neural activity. But, that can work just as well for IIT as it does Chalmers.
And I have no idea whether causal laws exist or what consciousness is. I guess IIT is as good an approach as any.
I have noticed a tendency, in philosphical discussions in general, for one party to hoist the discussion up from a specific issue to a very general and fundamental level. It is all very well to say that we can have no certainty whether causal laws exist or what consciousness is, but we must recognize that if that is one's argument, then one has effectively terminated the discussion as irresolvable: no matter how much empirical evidence emerges, it is not going to be enough to overcome this response.
If one takes this way to leave the discussion, then there would be more than just a hint of motte-and-bailey equivocation if one were to then re-enter it with a specific claim, such as that Chalmers or Searle or Koch have a plausible argument that consiousness cannot possibly be this or that.
As it happens, I very much doubt that IIT is on the right track, but at least it is (or was, initially) an attempt to find out what consciousness is, rather than what it is not.
What I meant was that future brain imaging technicians might be able to record your brain waves while you sleep and then, when you wake up, correctly tell you what you dreamed about.
However, it is also possible that future brain imaging technicians might be able to record your brain waves while you sleep and then use that data to construct a virtual reality experience that is so convincing that it could make someone else directly experience your dream.
> You can't feel that you're having the same dream as being that person's body.
You have no basis for making this claim except that we currently don't know how to do it. That is a very weak basis for such a claim.
> The problem is understanding how integrated information produces smells and pains.
Bear in mind, I'm not saying I myself believe IIT, I'm just trying to describe what it says. I don't know that "integrated information" is the right way to describe what it is about the neural activity in our brains that produces smells and pains.
> Why would some forms of information be conscious?
If I generalize this to "why would some forms of neural activity be conscious?", the answer is that consciousness has survival value, so neural activity that can produce conscious experiences evolved.
It’s not, because a Turing machine simulating conscious behavior could also be programmed to emit brain waves or NMR spectra similar to a real brain, without being conscious.
This whole theory seems like metaphysics because of this: it implies that among two systems with absolutely identical external behavior in all respects, one can have conscious and the other not have it.
Fundamentally, we can simulate neuromorphic computer (or even a quantum computer, or even the entire human brain) on Von Neumann machine (with performance degradation). According to our current understanding of physics, the behavior of these systems should be identical in all respects except the simulation will be slower. However integrated information theory says that a neuromorphic computer may be highly conscious and the brain is most definitely highly conscious, but their simulation isn't.
What's still unclear to me is whether this is indeed just metaphysics (i.e., the simulation and the real thing are absolutely identical and but we should still treat them differently from ethical standpoint), or is it a hypothesis about our physics (i.e., the brain somehow fundamentally cannot be simulated on a Von Neumann machine) as well as computational theory (i.e., neuromorphic or quantum computer cannot be simulated either).
It doesn't help that quantum computers can be simulated with standard transistors (albeit much slower). Are we really arguing that speed of computation is now a pre-requisite for consciousness?
"it implies that among two systems with absolutely identical external behavior in all respects, one can have conscious and the other not have it."
That statement can be true without being metaphysical. You can't treat a human as a black box, and then use inputs and outputs to definitively draw conclusions about what's going on inside the black box.
You could potentially have two black boxes that give identical outputs for the same inputs, yet have completely different mechanisms inside for arriving at those outputs. For example, say you have someone who's very good at arithmetic able to multiply two numbers. You put him inside one black box and a pocket calculator inside another. You give each box two numbers and they both output the product. Both black boxes will give you identical outputs for any given input. You know the box with the person inside is conscious, but this is not enough information to conclude the other black box is conscious.
It's quite possible that there is a way to simulate human behavior through some other non-conscious mechanism. And just because we can't currently prove whether something is conscious doesn't mean it's something metaphysical we'll never be able to prove.
For example, if two people tell you they're experiencing some pain, but one is lying about it, a few hundred years ago you'd be unable to prove it. That didn't mean pain is something metaphysical. Today, we know it might be possible to put both people in an MRI and prove whether they're actually feeling pain
I'm not an expert on the subject, but from my understanding a Turing machine is insufficient to simulate physics. [Bell's theorem](https://en.wikipedia.org/wiki/Bell%27s_theorem) proves that quantum physics is truly random, as opposed to being a deterministic system that we just can't measure precisely enough. A Turing machine is unable to compute a truly random number so therefore there could be quantum phenomenon that a Von Neumann machine cannot simulate.
It's not proven that consciousness can be simulated by a Turing machine. There's a possibility consciousness requires some hypercomputation to simulate
I've been thinking about this a lot, and I don't think AI will ever become conscious in the same way that humans are, rather, it'll be conscious on its own terms. Just like I can't know the mind of my wife, I can't know the mind of my cat, I also can't know the mind of an AI.
Depending on who you ask, a monkey or cat isn't conscious. From my point of view, I don't think you can really know that or recognize it. It's just a matter of degree of consciousness. I think it's safe to say that mammals are conscious to some extent. They have emotions, dreams, communication techniques, etc. we just have those (to some extent again) moreso than they do or we have them in different ways.
I think a question to ask is at what level or organization do we recognize self-direction? Am I conscious because I think so? What does that say about the bacteria that live inside of me that I rely on, or the individual neurons in my brain?
If both I and a dolphin are mostly the same, we have brains with neurons, we have blood cells, etc. how can you truly differentiate what is conscious and not? Even if you speak to another human it's not completely possible to say that they are conscious with certainty - only with what's most useful in day-to-day life.
At what level of circuity do we consider AI to be conscious? When it completes arbitrarily constructed tasks by humans? When it "feels"? How would you differentiate between sufficiently complex AI? Is there just AI or not? why?
AI can be conscious most certainly. Figure we can make bio robots in 100 years. All that needs to happen is building brains in the lab and bootstrapping them. The first versions will be somewhat mental but 2.0 most likely a better representation. After all, all species are quite mechanical and predictable—albeit complex.
> I don't think AI will ever become conscious in the same way that humans are, rather, it'll be conscious on its own terms.
I think that people who are attempting to simulate a human brain using an utterly biomimetic design stand a good chance of artificially creating something that is conscious in the same way that humans are. I also think it's possible they may be able to achieve this before they full understand how the human brain works. i.e. if you copy the design accurately enough, the machine may work even if you don't know how.
The resulting consciousness could theoretically be totally self-aware, but no more capable than we ourselves of modifying its own programming with intentionality and purpose. i.e. not the singularity.
I think there should be two different concepts of AI- "a consciousness using the same processes and design as our own", and "an essentially alien consciousness that fully understands itself". And I suspect that even if some engineering genie gave us the first kind of AI, we'd be no closer to developing the second kind.
I can not not think about J. Schmidhuber's thoughts on consciousness whenever the topic comes up:
As we interact with the world to achieve goals, we are constructing internal models of the world, predicting and thus partially compressing the data history we are observing. If the predictor/compressor is a biological or artificial recurrent neural network (RNN), it will automatically create feature hierarchies, lower level neurons corresponding to simple feature detectors similar to those found in human brains, higher layer neurons typically corresponding to more abstract features, but fine-grained where necessary. Like any good compressor, the RNN will learn to identify shared regularities among different already existing internal data structures, and generate prototype encodings (across neuron populations) or symbols for frequently occurring observation sub-sequences, to shrink the storage space needed for the whole (we see this in our artificial RNNs all the time). Self-symbols may be viewed as a by-product of this, since there is one thing that is involved in all actions and sensory inputs of the agent, namely, the agent itself. To efficiently encode the entire data history through predictive coding, it will profit from creating some sort of internal prototype symbol or code (e. g. a neural activity pattern) representing itself. Whenever this representation becomes activated above a certain threshold, say, by activating the corresponding neurons through new incoming sensory inputs or an internal ‘search light’ or otherwise, the agent could be called self-aware. No need to see this as a mysterious process — it is just a natural by-product of partially compressing the observation history by efficiently encoding frequent observations.
Schmidhuber is a great thinker in this field. I don't have a source, but I've seen him more briefly summarize this same point as "consciousness is a by-product of data compression." Pretty close to the last sentence you quoted.
That's appealing - certainly more promising than naively reducing consciousness to fan-in/fan-out, as in OP.
But it's also quite hand-wavey, because RNNs have no real hooks for self-reflection.
You can strap a meta-RNN across a working RNN, and if you're lucky it may start to recognise features in the operation of the working RNN. But are your features really sentient self-symbols, or are they just mechanically derived by-products - like reflection in a computer language, taken up a level?
You need at least one extra level of feedback to do anything interesting with this, and it's really not obvious how that feedback would work.
It's even less obvious if this will give you "genuine" experiential self-awareness, or just a poor and dumbed-down emulation of it.
>But are your features really sentient self-symbols, or are they just mechanically derived by-products - like reflection in a computer language, taken up a level?
Why couldn't we apply the concept to our self?
Self awareness is one commonly believed description for consciousness. Going off of that, we become self aware in three primary ways: 1) We're told about us by our parents at a young age, before the age of one. 2) We observe our selves in the environment often influencing the environment, from looking in a mirror, to social interaction. 3) We get meta about a series of things (body+mind) and self awareness arises from that generalized intelligence.
Though, you could argue that #3 may not be enough alone to create self awareness and ultimately #2 is required.
You are conflating consciousness[1] with self-awareness[2]. They are two distinct ideas.
In fact the second/third sentence on the Wikipedia page for self-awareness is:
> It [self-awareness] is not to be confused with consciousness in the sense of qualia. While consciousness is being aware of one's environment and body and lifestyle, self-awareness is the recognition of that awareness.[2]
One of my more vivid memories is excitedly opening my copy of Jayne's "The Origins of Consciousness in the Breakdown of the Bicameral Mind" and being dismayed as it slowly dawned on me that Jayne's entire book was based on this category error.
For the life of me I can't understand why people don't understand this distinction (or choose to ignore it).
I can only assume that people ignore the very obvious "magical thing" that is happening in their own heads due to ideological commitments to physicalism or something.
Is physicalism the problem? My understanding is that physicalism is still in good standing – at least when it comes to the conscious experience of qualia. (The concept-of-self encoding obviously doesn't require a physical substrate.)
Probably not, but I mean the kind of informal physicalist commitment that says something like "if I can't imagine quantum fields feeling things, then feelings don't exist." I see a lot of that, though less and less these days.
I think Chalmers helped clear the air a bit here, though I don't think jumping straight to panpsychism is particularly helpful to the discourse, either.
The problem is that physics is not the right level of abstraction and that we do not have an operational theory for working at the right level. I suppose it's also a problem that we can't seem to agree on the definition of consciousness.
Anyway, trying to understand consciousness by applying physics is just as silly as trying to understand why your complex fluid dynamics simulation is giving an incorrect result by peering at the CPU's transistors with an electron microscope: it's the wrong level of abstraction.
One thing that seems to be making our task a lot more difficult is that evolution doesn't even try to design the biology of systems with clean abstraction boundaries that we can understand. There are so many strange things going on in our bodies that we can barely describe them, never mind understand them. One example is what happens when a person consumes Ayahuasca [1].
What is this magical thing that is so obvious to you? Something may seem magical without being magical. To the person who survives a tornado while all his neighbors die, the sense they were chosen to live and have a special purpose can be compelling, but is false.
Materialism can't explain everything, but there is yet to be any proof that magic explains anything. Lacking that, assuming a physical basis as the explanation is prudent.
"assuming a physical basis as explanation is prudent" yeah, good luck making physicality relevant for most explanations. My wife asks why I didn't put the laundry away, for instance. "Physics!" I declare triumphantly.
Now, if I put music on and rub her back a bit... Well, ha! There's the magic, my good sir.
Imagine walking into a film studio with the idea of film production based exclusively on the principles of physics. No. Magic and physics are no more opposed than biology and physics. When hidden (psychological?) forces clearly underlie economically valuable phenomena (architecture, music, media, etc) respecting the magic is closer to the truth than reducing it to physics. Physics just isn't the right explanatory level.
If you'd like to learn more about definitions of magic that aren't "phenomena that don't actually exist", I recommend Penelope Gouk's work on music, science and natural magic in the 17th century. It's about the magic involved at the formation of the Royal Society.
On the subject, you are making a good point comparing social behavior with mental activity. Just like there is no “magic” in the way people interact with each other, there is no magic in how neurons do the same.
I think there's multiple definitions of magic at play here. One is phenomena that beyond the limits of human understanding. The other, based in the theory of vitalism, is something unexplainable, but also comes with the assumption that these unexplainable things are due some sort of vital force that living things have (often, specifically humans) [1].
When you talk about the magic of forgetting about the laundry, you mean the first kind of magic. When others talk about consiousness being inaccessible to AI, they're talking about the second kind of magic. I don't think it's that hard to imagine an AI that would forget to fold the laundry and not know why. The main problem with a "concious AI", I suspect, is that nobody will actually want one.
[1] I have no idea if viruses or prions are supposed to have vital force, vital theory emerged before most of modern biology and is mostly used today by those who have no understanding of modern biology.
> Now, if I put music on and rub her back a bit... Well, ha! There's the magic, my good sir.
Your answer is rather flip.
Also, if you want to redefine "magic" to be nice things that are physically based but can't be summarized in a neat equation, then I also have no desire to argue. It is clear that the person I was responding to meant "magic" in a different way that you seem to be using it.
If you want to think magic is Harry Potter, fine. But it has an intellectual history that can help frame our interpretation of contemporary technology. Recommended reading:
https://plato.stanford.edu/entries/pico-della-mirandola/
> Now, if I put music on and rub her back a bit... Well, ha! There's the magic, my good sir.
Sure. There's also the magic of feeding my cat, so he stops nagging me, and sits on my lap purring. And just about everyone would agree that's similar, no?
But what about the magic of running "sudo apt update" before "sudo apt install foo"? That's also arguably similar, albeit many orders of magnitude simpler.
Well, to my mind you seem too hasty to conclude it's false. Sure, statistically there is a very small non-negligible chance that exactly one person will survive, but realization of an unlikely event is no short of a miracle. To conclude that it happened randomly seems as naive as to conclude it happened purposefully. If your guts tells you it was a random event that is just fine, but be aware it is a metaphysical axiom of yours
Certainly nothing can ever be conclusively proven. I might be a brain in a vat that has had a fictional reality fed to me for my entire life. Such arguments may be interesting in some venues, but is HN really that venue?
> To conclude that it happened randomly seems as naive as to conclude it happened purposefully.
I strongly disagree. You aren't saying that both outcomes are possible (I'd agree with that), but they are equally likely, a much, much stronger claim. The sun might go on shining tomorrow, or it might collapse due to some unforeseen physical process. Both have non-zero probabilities, but it is the person who claims they are equally likely who is the naive one.
As for not defined so let's interpret "miracle" to mean highly unlikely events, they happen millions of times day, and we rarely notice. The bill I received in tender has the serial number MF53610716D. What are the odds of that? If you limit "miracle" to be highly unlikely events that most people would also notice, it would be strange if they weren't happening all the time. Every person who wins a lottery (and there are thousands every day), the person who is told by their doctor their cancer is terminal but then it goes into remission has a "miracle", the guy who loses his job and is about to be evicted then gets a job callback for an application he sent in months ago and forgot about experiences a "miracle."
> I can only assume that people ignore the very obvious "magical thing" that is happening in their own heads due to ideological commitments to physicalism or something.
You nailed it. People think that accepting consciousness is hard is giving into religion.
After thinking about it for many years I've come to the conclusion that some people really haven't noticed themselves, (e.g. I think Daniel Dennett is a p-zombie!)
Oh no, I do not mean that in a pejorative sense. I have a lot of respect for him and his work. It's a way to understand how someone so thoughtful and intelligent and dedicated can seemingly be unaware of the "hard problem". One day it occurred to me that maybe he just hadn't had the "breakthrough" or "epiphany". It's unlikely but not impossible.
FWIW, his wikipedia entry says,
> He also presents an argument against qualia; he argues that the concept is so confused that it cannot be put to any use or understood in any non-contradictory way, and therefore does not constitute a valid refutation of physicalism. His strategy mirrors his teacher Ryle's approach of redefining first person phenomena in third person terms, and denying the coherence of the concepts which this approach struggles with.
that's specifically what I don't like. In re: the "hard problem" he wants to declare victory without a fight, or a prize.
That's the position of philosophy on the philosophical view of consciousness. The broad, intuitive notion of consciousness often does equate it with self-awareness, indeed in the conscious link you have:
"Today, with modern research into the brain it often includes any kind of experience, cognition, feeling or perception. It may be 'awareness', or 'awareness of awareness', or self-awareness." Etc.
I'm more of a fan of this view than the specifically philosophical view of consciousness. This latter sort axiomatizes, pares-down, an intuition that is, itself, so vague that axiomatized version winds up not having any definite qualities or characteristics, just "I know I experience it".
Colors, tastes, feelings aren't vague nor are the thoughts, imaginations, dreams they makeup. They're the stuff of consciousness, and somehow you have to demonstrate how awareness results in those experiences. Shifting definitions to avoid the hard problem doesn't cut it.
You have no idea if you live in a world of zombies who just say they perceive qualia, who just give the appearance of seeing red.
I don't see it as a real problem. If a program or machine asserts that it perceives qualia, who are we to argue it's wrong? We are in no better a position to prove the qualia of our subjective conscious experience other than our physical resemblance to our interlocutor.
Maybe qualia is what it's like for matter to be in a feedback loop with physical interaction. Panpsychism is pretty much my position.
> I don't see it as a real problem. If a program or machine asserts that it perceives qualia, who are we to argue it's wrong?
Right now, we are in no position to argue it's wrong, because we have no accepted framework for understanding qualia.
That said, we can still make some simple assertions with confidence such as:
1: A one-line program which prints "I am afraid" does not experience fear qualia.
2: A human being which utters the words "I am afraid" may be experiencing fear qualia (and thus perhaps experiencing pain/suffering).
If you assert that the world is full of philosophical zombies rather than humans like yourself, you may not agree with assertion #2. But we build our ethical and legal frameworks around the idea that we aren't philosophical zombies, rather, that we have feelings and want to avoid suffering.
Once you start talking about more complicated programs, though, we don't know what the right assertions are. We don't have an understanding of what things can suffer and what things cannot, for starters. We generally agree that, say, dogs can suffer. That's why we have laws against animal abuse. But what about programs?
It is absolutely a real problem, because some day we will have to build laws and culture around how we treat AI. Whether or not an AI can suffer (ie. by experiencing qualia that can be considered undesirable) will likely affect how we treat that AI. If we have no way to answer "can this program suffer?", then we are setting ourselves up for regret.
Once an AI is advanced enough to make the question hard to answer, isn’t the odds that the AI will be advanced enough to simply decide the answer for us?
I imagine thane once someone manage to produce an AI with enough agency to seem sentient it will far exceed human capabilities.
I think there is a step or two missing in between. Abusing dogs isn't just as bad as abusing something that suffers. It's, e.g., doing something that has no value to society (unlike animals being mistreated in a feed lot), or it's something that sews unacceptable levels of aggression. It feels much more complicated than you make it seem.
I took it as necessary condition, not a sufficient condition. The other necessary conditions were omitted because they aren't important to the line of reasoning being presented.
Ned Block covers this in his paper on the Harder Problem of Consciousness. Other humans share a similar biology, so we have good enough justification to think they're conscious. It won't defeat solipsism, but it's enough to make a reasonable assumption.
Data or whatever AI/Android doesn't share our biology. And since we can't tell whether it's the functioning of our biology or the biology itself which provides us with consciousness, we lack any reasonable justification for assuming Data is conscious. And then he goes further into functional isomorphs at different levels and how that might or might not matter for Data, but we can't tell.
> Other humans share a similar biology, so we have good enough justification to think they're conscious.
That's the way it goes with these arguments: it always comes down to an appeal to what's reasonable or plausible (those who insist consciousness must be an algorithm are doing the same thing, at least until we have algorithms that seem to be making some progress on the hard problem.) One might equally say other humans share a similar physics. When Dennett said "we are all p-zombies", I suspect he was making the point that it would be highly tendentious to take the position that anything both behaving and functioning physically in the manner of a human would not be conscious, except for humans themselves.
I see a lot of resemblance in biology between myself and cats, does that mean that cats have qualia? I infer they dream from their twitches as they sleep.
How about mice? Lizards? Fish? Insects? Nematodes? At what point do qualia stop occurring? I see a more or less continuous decline in similarity. I don't see any justification for a cut-off.
I don't think data is conscious. I suspect consciousness might be a side-effect physical computation. I don't believe there's any magic to the human brain's inputs and outputs which cannot be computed, and thus display the appearance of consciousness. In fact I see the Turing test as a thought experiment more than any actual test, a way of removing the appearance of a human body from the task of evaluating an artificial intelligence as a thinking, conscious being. If it quacks like a duck, a rose by any other name, etc.
In fact I'm not entirely convinced that the Western conception of consciousness isn't a learned cultural artifact, that there aren't people who have a more expansive notion of self which includes close family, for example. Have you ever suffered watching a relative hurt themselves? Ever had false memories of injury from childhood which you found out later happened to someone else?
As far as I understand it, the "hard problem of consciousness" is the claim that consciousness is something absolutely separate, that there is a jump between constructive processes that make up the informal view of consciousness and the full formal, philosophical view. That approach always seemed like a complete dead end.
I mean, "philosophical zombie" construct would seem to experience "Colors, tastes, feelings" and whatever concrete, they just would lack the ineffable quality of (philosophical, formal) consciousness - you could brain pattern akin to color sensation for example. This final view is kind of meaningless and I think people are attracted to the view by misunderstanding, by thinking something concrete is involved here.
The concreteness is your own subjective experience. All this other stuff about constructive processes and zombies is word play. It doesn't change your experience.
The issue is providing a scientific explanation for how the physical world produces, emerges, or is identical to consciousness. Arguments like p-zombies and Mary the color scientist are meant to showwe don't know how to come up with such an explanation, because our scientific understanding is objective and abstract, while our experiences are subjective and concrete.
I prefer Nagel's approach to the hard problem, as he goes to the heart of the matter, which is the difference between objective explanation and subjective experience. Science is the view from nowhere (abstract, mathematic, functional), while we experience the world as being from somewhere as embodied beings, not equations.
In your example of qualia (Colors, tastes, feelings), how is that not awareness? That is what is the difference between awareness and consciousness here?
In your example the abstractions of qualia (thoughts, imaginations, dreams), how are they not labels of experience? That is what ML does, after all.
Today ML may, for all intents and purposes, have roughly the intelligence of a bug, but it has to have awareness to label data. Where does consciousness come in beyond labeling and awareness that ML does not have today?
Do you think that ML algorithms are having experiences when they label data?
We label experiences with different words because we have different kinds of experiences. But it's the experiences and not the labels that matter, and the labeling of those experiences does not cause the experience. We say we have dreams because we do have dreams in the first place.
You're proposing that labelling data is the same thing as having an experience, but you haven't explained how data is experience, or why the labelling matters for that.
More seriously though, if we agree that the brain is described by physics, then all it can do, a turing machine can do as well, so at the root all experiences have to be data and computation.
Perhaps, but keep in mind that physics is a human description of the universe, not the universe itself. So it may also not be data and computation, as those might just be useful abstractions we create to model reality. Same with math.
But that gets into metaphysics, which is notoriously tricky.
That's why i say "if we agree that the brain is described by physics".
If you argue that a brain cannot be described by computation and there is something supernatural like soul, that's a fine theory, and the only way to disprove it, is to create working general ai.
I am not really sure about the value of this philosophical positions, since the ones i have seen, simply suggest to ignore logic for a little bit, to obtain the result they feel is correct.
The suggestion by Penrose that consciousness is connected to quantum state, and so cannot be copied, or computed on any classical turing machine fitting in the universe, is an interesting way to circumvent strange predictions of functionality, but is not very plausible.
And Jaron Lanier from your other comment explicitly suggests to not use approaches like that, because it would weaken vitality argument, when proven wrong.
It's only "insulin" and "cells" for someone interpreting the program. The issue here is that if you had a simulated brain, what makes that simulation a brain for the computer such that it would be conscious?
He's meteor shower intuition pump is similar to the argument that nations should be conscious if functionalism is true. The reason being that any complex physical system could potentially instantiate the functionality that produces a conscious state. It's also similar to Greg Egan's "Dust theory of Consciousness" in Permutation City.
If one is willing to bite the functional bullet on that, then you can have your simulated consciousness, and the universe may be populated with all sorts of weird conscious experiences outside of animals.
>Do you think that ML algorithms are having experiences when they label data?
Yes, but not in the way we have. An RNN keeps track of what is going on, for example.
To take in information through sense inputs (eg, eyes) is experience, but in an unconscious way. We get overloaded if the information we take in is not deeply processed before it becomes conscious. A CNN is similar in this manner, but also quite alien.
When we're born our brains have not formed around our senses yet. Our brain goes through a sort of training stage taking in raw sensation and processing it. The more we experience of certain kinds of sensations the more our brain physically changes and adapts. It's theorized if you made a new kind of sense input and could plug it into a newborn brain correctly, the brain would adapt to interfacing with it.
This strongly implies qualia is real, in that we all experience the world in drastically different ways. It may be hard to imagine but my present moment is probably very alien compared to yours, as is with different animals as well as simpler things like bacteria and ML.
Is this distinction necessary or strictly proven? They seem pretty linked in my personal experience. (All the times I'm not conscious, like when I'm sleeping, I'm not self-aware, and vice-versa. Intuitively it seems like anything that might put me into a semi-conscious state would be considered as also putting me into a semi-self-aware state and vice-versa.) The page lists several disorders related to self-awareness, but I don't think any of them represent anything like "0% self-awareness yet 100% consciousness" which would have more strongly implied that they may be different things.
The page lists several types of self-awareness, including "introspective self-awareness". Maybe what we call consciousness is just the internal experience of something with introspective self-awareness. This does raise the question of what "internal experience" is though. I think "internal experience" is what some people mean by "consciousness", especially when they say things like "maybe everything has consciousness including rocks or random grids of transistors". I think there exists some sense of "what it is like to be a rock", but it's an utterly empty experience without memory, perception, personality, emotions, or the feeling of weighing choices; something very close to the "null experience", that is an experience in the same sense that zero or a number utterly close to zero is still a number. The internal experience of a random grid of transistors only just barely starts to touch a sliver of what a human's internal experience consists of. The internal experience of a worm starts to have a few recognizable qualities (proprioception, the drive to maintain personal needs), but it still lacks many large aspects of a human's internal experience. (Maybe a thermostat with sufficiently rich inputs, output control, world model, and juggled priorities has an internal experience similar to a worm.) Large animals tend to have more elements of awareness (including memory, social awareness, and some introspective awareness) that bring their internal experience closer to having what feels like the necessary elements to human consciousness.
I'd say you're off. I'd describe the experience of the worm much in the same way you're describing the experience of a rock, just a couple biochemical circuits. And the experience of the rock would be even more atomically null to compensate.
I'm not sure we're in disagreement: I agree that a rock's experience is practically null (maybe the fact that its atoms are connected and may be pushed and pulled together makes up the tiniest grain of internal experience), and that a worm's experience is still a world apart from ours and probably much closer to a rock than us. If we were to score an experience on how human-like it is, I'd expect the various elements I named to each refer to exponential or greater increases in score. Comparing the depth of a worm's experience to a human's would be like comparing the volume of a nearly 1-dimensional line segment to the volume of a many-dimensional hyperobject.
Our brains are just tons of biochemical circuits working very mechanistically, with many interesting feedback loops going on that make up our internal experience. A worm's brain has a small and probably countable number of feedback loops going on that I assume make up its tiny internal experience.
You act like these are well defined and agreed upon categories. The page on consciousness you link lists off many different definitions people attribute to consciousness, including: "It may be 'awareness', or 'awareness of awareness', or self-awareness."
I forget who said it - and it's probably somewhere tucked in these comments, but paraphrasing...
If one were to simulate every drop of rain, gust of wind, and tidal current of a hurricane, to ultimate perfection, would you say the processor is wet?
Right -- consciousness is whatever it is that is aware that it is self-aware. In fact, anytime you pinpoint consciousness as any particular awareness, you beg the question. How can you be aware of your awareness?
If your brain has a computational process for awareness, and it has itself somewhere in the inputs... that’d make you aware of your awareness, no? It’s recursion!
The only way to build a recursive loop is to say that awareness is some state (the output of the awareness process). But that just begs the question, how could awareness be a state? If it is a meta-phenomena (i.e., the result of some sort of complexity or self-referential loop) then what exactly is aware that one is aware?
>You are conflating consciousness[1] with self-awareness[2]. They are two distinct ideas.
Consciousness is not an idea and ones who experienced a little bit of it (via meditation or some chemicals or other ways) will laugh at all attempts philosophers and scientists are doing to define it. Simply because you can only define something which you can observe from aside, but here there is no outside, everything is inside it. How can you possibly define that? :D
This sounds like some kind of "cognitive homunculus" looking at itself in a mirror. Does it explain anything, or just push the question of what is perceiving the subjective experience one level deeper?
and here I am reading Frank Herbet's Destination : Void which deals with developing a consciousness. From ideas of introducing emotions to purposefully having errors in the system
there was a young man who said "though it seems that I know that I know, what I'd like to see is the 'I' that knows me, when I know that I know that I know."
And I am amused by how someone always rolls out this observation as if it settled the issue for good. It's a caution against mistaking familiarity and "it seems to me that..." for the way things must be, which all parties to the discussion would do well to heed.
Of course we can make an AI be aware of surroundings and able to react.
What do most people mean by become conscious?
My assertion is a majority of people cannot even prove how they're different than a robot that's programmed to complete tasks within its lifecycle.
We all think we're so special and in control but there is no proof. We have to ask ourselves can we prove that we're any different than an input & output machine first.
Your comment is too vague for me. I assume you're attempting to assert that sleeping while having awareness of being asleep would somehow make you different than a robot? I would challenge that notion if my assumption is correct on what you're expressing by simply stating a robot can be programmed to experience similar.
All this is underpinned by your definition of conscious.
I recall seeing Koch in debate with a philosopher (it was long ago I can't recall but one of the big ones: maybe Searle or Dennet) and they were talking past each other.
For Koch, at least in this debate, consciousness was something akin to attention. For the philosopher, it was something else entirely (if I remembered, I might be able to guess who it was).
Consciousness could mean: making a decision as opposed to having it pre-ordained, or the experience of your senses, or "feelings" or knowing you are a self, or who knows what else.
It isn't just a computer science issue, it is a philosophical and linguistic one too: just what do you mean by the word.
You can say that as matter of factly as you want but that doesn't change the long philosophical debates around determinism, liberalism (not the political kind), and free will.
You might be misunderstanding that debate then because what's usually termed Libertarian Free Will which is the type that most people think they subjectively experience, that is the ability to choose from different paths at any given moment, almost certainly does not exist in humans and most philosophers agree on that at least.
Yeah, you get something which feels like free will which is physical universality along with quantum randomness (which can be deterministic RNG.)
Physical universality just means that the body appears to have a symmetry with regard to its operation over space and that it also appears to be self-contained (noise resistant computation.)
The randomness along with the noise resistance collude to create the appearance of self-contained agency. Of course eastern doctrine and even western physics knows there are no separate entities. Especially when the QM dicerolls are considered..you at their mercy for your supposed choices.
> For the philosopher, it was something else entirely (if I remembered, I might be able to guess who it was).
"Qualia" perhaps, which is a sleight-of-hand which amounts to shoving the complexity around on the plate: Consciousness depends on qualia. What's qualia? Exactly.
I think consciousness is a continuum, and humans slide up and down that continuum all the time, from deep sleep to nearly-autonomic behaviors like doing purely rote tasks to, at the other end, being very aware of everything because you just heard a rattlesnake rattle and need to know where it is right now.
Is AI conscious? I think it fits somewhere at the lower end of the spectrum. Is a flatworm conscious?
Qualia means the experience of a particular sensation, like colors, sounds, pains. It's not a sleight-of-hand. We do have those experiences. The difficulty is that they are subjective.
My problem is that qualia leads into the idea of philosophical zombies, or people who act like they're alive and think they're alive but don't have qualia. The trick is to either prove they don't exist, or prove you're not one of them, while also not granting qualia to, I don't know, flatworms or search engines. Which is the same thing as proving things about consciousness.
The P-zombie thing is a nonsense, since it posits an unconscious entity that acts and reacts exactly as a conscious entity would - which would include answering any questions you asked about their experience in exactly the same way. That means that their "synthetic" qualia are indistinguishable from "real" qualia, the insistence of philosophers with preferences notwithstanding. It's just good old Cartesian duality with a new wig.
So if your definition of qualia involves an unfalsifiable claim, or other things that we have no mechanism for proving to be true or not true, then it taints all the arguments that spring from your first.
> It's just our good-old chinese room in a new wig.
Semantics and consciousness are distinct arguments. So one's position on whether manipulating symbols can achieve meaning is separate from whether consciousness has an objective explanation, or at least one humans are capable of providing. Searle might think the two are related, but Chalmers likely disagrees, and there's likely people who disagree with the hard problem, while finding the Chinese room convincing. Or so my exposure to these sorts of topics would indicate.
In any case, a position on one does not commit one to a position on the other. It's dismissive to make that sort of claim, and fails to understand the nuances of philosophical argument.
It's not necessarily the same thing as proving things about consciousness. The two could be orthogonal.
If qualia arise only in particular configurations of physical substrate, then it might be possible for flatworms to have qualia but not search engines. This doesn't mean the flatworm has a concept of self, a concept of time, or even low-level cognition. "Nobody home", so to speak. But the basic qualia of light/dark/hot/cold might still be present.
Scott Aaronson and Giulio Tononi debated IIT five years ago. Personally, I think Aaronson had by far the stronger argument, and my much less analytical response to IIT is that it broadens the definition of consciousness to the point of being uninteresting and unhelpful.
From the article (Christof Koch's words):
"The theory fundamentally says that any physical system that has causal power onto itself is conscious. What do I mean by causal power? The firing of neurons in the brain that causes other neurons to fire a bit later is one example, but you can also think of a network of transistors on a computer chip: its momentary state is influenced by its immediate past state and it will, in turn, influence its future state."
In this view, a building with a thermostat would seem to be conscious to some degree. I very much doubt that any amount of study of simple systems that fit this definition will tell us anything useful about the sort of consciousness that is displayed by, for example, humans.
> In this view, a building with a thermostat would seem to be conscious to some degree.
I don't think this is as overly broad or bad of a definition as you presume. I recall sitting at a laundromat one day, in a somewhat sleepy state daydreaming, with the rhythm of the washing machine in front of me playing through my mind. My subconscious told me that the machine was conscious. I dug deeper into that intuition, and realized I was seeing a bit of the inner workings of the mind of the engineer that designed the algorithm. Not a perfect example, as I didn't know if the alg was closed-loop, but in any case, it made me realize that our minds are just large bodies of these algorithms working together. We have some additional oracles, random data generators, and probabilistic mechanisms thrown in as tools, but consciousness really is mechanistic and pluralistic.
To recreate it requires not only the qualitative aspects of a being that can think, but also sufficient (read: vast) quantity of systems to get to a useful general purpose thinking machine. There is no "soul" or special sauce or singular definition of consciousness. It's an illusion.
I personally don't understand how a logically and rationally thinking person could get to a conclusion anything other than that we are a combination of algorithms. So essentially we can in theory be simulated and there is nothing special about us. In this case the machine simulating us would be as conscious as ourselves.
It seems any other conclusion is just fooling oneself.
One reaction to that statement might be "so be it."
I did not, however, come here to defend the idea that consciousness is an algorithm. Personally, I consider it rather more plausible that a computer plus a random number generator might achieve consciousness through simulating the sorts of physical processes that occur in a brain, and if it is a 'true' random number generator, rather than a deterministic PRNG, then we are no longer talking about math, at least in the sense that you use to conclude Platonism.
One might respond by saying that if the universe is deterministic, then there is no such thing as a 'true' random number generator, as distinct from a PRNG. My understanding of the philosophical implications of QM, and its competing interpretations, is insufficient for me to be sure whether the universe as we experience it is deterministic, but regardless of whether it is or is not, I suspect that the true hard problem of consciousness is 'why do we (feel that we) have free will?'
> I suspect that the true hard problem of consciousness is 'why do we (feel that we) have free will?'
Free will and consciousness are separate issues. You can potentially have one and not the other. What's important for free will is whether choice is free and what that freedom amounts to. What's important to consciousness is subjectivity. You can feel pain while not having a choice about feeling that pain, say if you were restrained and unable to do anything about it, just to give an example.
And potentially, a robot could be free to make choices while not feeling anything.
I doubt that 'will', as it is commonly conceived, has any meaning, or at least a very different one, for a non-conscious agent. It's similar to the way i think IIS is clouding rather than clarifying the issue. For related reasons, I feel that compatibilist positions on the issue are largely avoiding it.
I don't think there can be or is a reason to believe there exists a 'true' random number generator. What's the reason to believe such a thing exists?
If something seems random to us likelier explanation is because we couldn't observe it from close enough so we do not know the exact algorithm/causes behind that event or occurrence.
To me it seems like even if there's a random number generator there's no reason to believe such a thing exists. Simpler explanation is that there's some logic involved which we just can't observe (yet).
Same thing as we can't prove that a man in the cloud does not exist, but there's no good reason to believe that one exists - except for people's ego of course.
We are obviously more than just "algorithms". Algorithms don't have free will. Unless you are also arguing there is no such thing as free will and that the world is just playing out in a predetermined physics reaction? Yet even that doesn't 100% jive with physics because quantum mechanics are not deterministic.
> Yet even that doesn't 100% jive with physics because quantum mechanics are not deterministic
QM is a branch of physics, with some theories having multiple interpretations, some being deterministic and some non-deterministic. By this I mean, quite literally there exists deterministic and non-deterministic models of the same phenomenon, which both work in accurately describing said phenomenon.
As so, it hasn't been proven whether QM is deterministic or non-deterministic.
Regardless, in cases where it skews non-deterministic - how can we be certain that the exhibited randomness isn't just simply because we aren't accounting for all conditions there is to know about the phenomenon (hidden variables)?
Before shooting that down, Bell even admitted his own theorem does not rule out determinism - as determinism which evades it - he calls "superdeterminism".
While I wouldn't claim a special case for us over machines as a foundation for consciousness, plenty of logical and rational people consider a reduction of cognition ("AGI") to algorithms to be a naive but understandable approach in early decades. There has been zero success with it in creating a sentient being in all that time, so who's fooling themselves?
And that's just cognition; not consciousness which is a different matter, and still not even understood on a philosophical level, let alone scientific - physics, computing or other.
You should consider the possibility this is a gap in your understanding, rather than a privileged access to rational and intelligent thought over others.
I don't think it's bad to describe a building with a thermostat as a (very) little bit conscious. It would be interesting to formulate a spectrum of consciousness. Something like:
Level 0: Inanimate objects like rocks. They move when moved by something else but not on their own.
Level 1: Objects like mechanical locks that move iff interacted with but do make some sort of "choice". (ie opening or not opening depending on the key used in the case of the lock)
Level 2: Systems that interact with their environments but in very mechanical ways, like mosses, trees and thermostats. It is essentially predictable how the system will behave when disturbed in certain ways, ie it does not learn or only in a predictable way (like trees growing around obstacles).
Level 3: Systems that can actively learn about their environment and use the knowledge to get what they want. Most animals would be here.
Level 4: Systems complex enough to form a "theory of mind" about other beings. Most social animals would be here.
Level 5: Self-aware systems, which can form a theory of mind about themselves. Complex planning lives here.
There might be levels higher than self-awareness, but I can't think of any examples (obviously, since humans are as far as we know the most intelligent beings on Earth). Some attributes a hypothetical "level 6" system might have:
- Perfect insight in their own motivations. Humans clearly lack this but it does not seem impossible.
- Better ways to communicate qualia. The colour purple or the taste of strawberries is difficult to explain for humans, but once again it does not seem like it would be impossible.
- Ability to "really" multitask. Once again something that is not theoretically impossible but very difficult for humans to do.
This (from the top Level 5 down) is one of the arguments proposed by the thermostats-are-conscious people, an argument that often leads to panexperientialism and related theories. Most famously espoused by Chalmers in his classic division of philosophy of mind into hard (consciousness) and "easy" (cognition, etc) problems.
>Level 0: Inanimate objects like rocks. They move when moved by something else but not on their own.
If you want to explore it deeper - take a leaf. It is like a rock not moved by itself. But wind can pick it up and move it. Now the question is - does the leaf happen in a way that it can be moved by the wind by accident or there is some "intelligence" behind it? See that moving leaf is exactly like any moving object is not moved purely by itself - when you move it happens together with other forces like gravity and friction (rubbing? not sure how it's in English) and so on.
So maybe rock is the same in this way just it requires more (or better say different) energy to move as you require different energy to move compared to a leaf. If you look this way everything is conscious and works together, there is no single, separate entity anywhere in the Universe. And all things somehow working together on billions visible and invisible levels can be called consciousness.
Sure, there could be a universe-wide field of "level 0.1" with local spikes where more complexity lives. At that point it just becomes more a question of definition though.
"Tononi gives some simple examples of the computation of Φ, showing that it is indeed larger for systems that are more “richly interconnected” in an intuitive sense. He speculates, plausibly, that Φ is quite large for (some reasonable model of) the interconnection network of the human brain—and probably larger for the brain than for typical electronic devices (which tend to be highly modular in design, thereby decreasing their Φ), or, let’s say, than for other organs like the pancreas. Ambitiously, he even speculates at length about how a large value of Φ might be connected to the phenomenology of consciousness. ... Now, evaluating a polynomial on a set of points turns out to be an excellent way to achieve “integrated information,” with every subset of outputs as correlated with every subset of inputs as it could possibly be. In fact, that’s precisely why polynomials are used so heavily in error-correcting codes, such as the Reed-Solomon code, employed (among many other places) in CD’s and DVD’s. But that doesn’t imply that every time you start up your DVD player you’re lighting the fire of consciousness."
Holy poop!
So, spaghetti code is more "conscious" than modular code and parity check code is more "conscious" than any physical entity. Yeah, there's something wrong with this theory.
For philosophers that adhere to modern or post-modern schools of thought consciousness is usually related to being self-aware enough to set up a framework to reason about things like "what is consciousness" or ask oneself or ourselves if we have a higher purpose besides keeping our bodies alive. The attention framework allows some quick thought tricks like equating your AIs behavior to non-human animal behavior and then you can use frameworks from ecology or biology to reason about it.
Other frameworks allow for more sophisticated experiments like setting up AIs to interact against each-other and see if they come up with systems or concepts similar to sociology or economy or at least reason that they decided that those were not useful. the attention framework needs to be stretched a bit to be able to justify this experiments.
I took Searle's philosophy of society and philosophy of mind courses in undergrad. A lot of Searle's theory of consciousness is tied to biology. A lot of his theories were based on causal notions (thinking I need to move my arm, makes my arm move for example).
It does seem that we have all the tools necessary to create artificial consciousness.
We have relational databases, text file data structures, key/value storage systems, cryptographic signature systems, etc. These can form the core basis of cybernetic memory.
But it seems nobody has been able to formulate the arrangement of code and ideas, and a vision, to bring it all together.
A neural network is just a very sophisticated pattern recognizer. You need a higher algorithm than that, in order to kickstart an artificial consciousness.
It’s not real of course. It’s just a collection of electrons, following a probabilistic decision tree, with a somewhat deterministic approach, to reaching a mathematical conclusion, based on a series of linear equations, in order to select the optimal winner.
But when the robot talks back to you, and recalls everything that you did together, and how it “felt” at that moment, then, it will seem and appear, to be very real.
I believe that we will eventually have an AI that will meet most observers' definition of consciousness.
That being said, I think there existed serious people who thought we would have one before 2020, even as late as 5-10 years ago, using technologies that don't seem wholly adequate to the task now (expert systems, fuzzy rule systems, multi-layer perceptrons, etc).
At what point does the non-existence of machine consciousness begin to make us skeptical that such a thing is possible, that no algorithm describes consciousness?
I have yet to hear a good argument against the idea that we can create a conscious artificial intelligence. We know that we are conscious, whatever the definition is we use ourselves as the benchmark. So at the very worst, we can artificially create a human brain. But beyond that, we have plenty of things that imitate roles in the human body by doing the same actions the body does (artificial limbs, respirators, assisting with blood filtering). There is just no evidence that something about the brain is special to the extent that we will never be able to replicate it. All arguments seem to come down to having a soul, but without saying that because it's clearly a non-scientific claim.
I can appreciate that architecture may be a hard limit for us here. However, if we build systems that replicate human consciousness effectively enough, I don't actually see any difference between reality and artificial conscious beyond the definition.
I think the crux of this is defining `consciousness`, which I haven't seen defined in a way that I feel is sufficient in this context and can be tested/measured.
I can program a chat app where if you ask `are you conscious` it will say `yes`, but I think we can all agree that does not amount to consciousness. So how do we define consciousness in order to determine whether human technology is capable of exhibiting it?
Ultimately, following a measureable definition as a guideline, I imagine that any number of people might argue whether human tech can become conscious... I would guess it really comes down to people having very different definitions of consciousness.
I so far lack an eloquent definition of my perspective, but I feel we fundamentally lack the ability to 'create' consciousness, and ideas of 'conscious AI' and 'digital afterlife' make me involuntarily roll my eyes.
I don't really understand the definition argument, I cannot imagine a definition of consciousness that feels like it's in good faith and sufficiently difficult to capture intelligence and consciousness. Either you make a definition that seems we can clearly make that system eventually, or the definition is something that most would call unfair and narrow. Can you think of a "fair" definition that seems like AI systems couldn't get there? If not, this is not a valid counter point, and more of a communication problem.
Any definition about a subset of tasks or creativity clearly is possible by AI systems, given the progress we're already seeing.
On the one hand, I appreciate the notion of the author that consciousness is related to any system which changes over time as a result of itself. That you can use this definition to try to measure whether a human in a vegetative state is still "conscious" is a potential use showing the benefit of this definition...
What I find dissatisfying is that in the next breath, the author dismisses the possibility of a machine that changes over time in response to it's previous state to have any possibility of consciousness ever. If you do that, then clearly the definition of consciousness was useless to begin with. We are just defining the words to include things we like, and exclude things we dislike.
I agree. I made a response below, but I think the definition of consciousness as a counter point to us ever making a conscious machine really doesn't have any legs. Can you think of any definition of consciousness that is reasonably impossible for an AI system to satisfy? Other than things like "a living human" or "a non-machine system", or some other clearly ridiculous constraints.
>" The more the current state of a system specifies its cause, the input, and its effect, the output, the more causal power the system has. Integrated information is a number that can be computed. The bigger the number for a system, the larger its integrated information, and the more conscious the system is."
I'm generally sympathetic to the idea that consciousness and "computational power" are not identical but the larger problem with all of these theories in my opinion is that they're really just stories that clarify intuitions one has about consciousness.
I think the problem with the consciousness question is really that it's hard to probe into what consciousness actually is. It's completely possible to give different accounts of conscious experience even though systems behave the same, including that consciousness doesn't exist at all, and really there's no empirical way to agree or disagree.
I've started to think of expressions about consciousness more or less the same way emotivists considers ethical statements. Emotivists argue that saying something like ""You acted wrongly in stealing that money" is equivalent to "You stole that money". The first statement does not add any true or false statement about the situation, it's merely an expression of emotional sentiment.
In the same sense I don't think "machine x does y" expresses fewer facts than "machine x does y, and it is conscious".
> In the same sense I don't think "machine x does y" expresses fewer facts than "machine x does y, and it is conscious".
brings to mind behaviorism, which was of course influential and compelling for a long time. The problem with behaviorism, if you want just one problem, is how do you even talk about something like Synesthesia within behaviorism? It's (initially) a purely subjective/qualia related experience. While behaviorism was in vogue, it was difficult to take Synesthesia seriously and it was dismissed as people being poetic and metaphorical, but those who experienced grapheme-color synaesthasia could see shapes present in a number-pattern readily that those without it could not see.
> Any AI that runs on such a chip, however intelligent it might behave, will still not be conscious like a human brain.... No. It doesn't matter whether the Von Neumann machine is running a weather simulation, playing poker, or simulating the human brain; its integrated information is minute. Consciousness is not about computation; it's a causal power associated with the physics of the system.
There are serious problems with this. Koch will have to explain how a simulation of a brain can reproduce to perfect detail all the possible behaviors of a brain without having an equivalent integrated information. Presumably integrated information is a property of the organization of a process, and as such it should have consequences for its set of possible behaviors. So if the von Neumann system has constrained integrated information, its behavior should be constrained as well in some externally identifiable way. But by assumption the simulation could be arbitrarily good. How does Koch break this tension?
The other glaring issue is the fact that consciousness under this view has no explanatory power for the system's behavior. If a non-conscious system can reproduce exactly the behavior of a conscious system, then there is nothing informative to the behavior from the property of conscious; it is entirely incidental to a conscious system's behavior. It doesn't explain why a conscious subject winces with pain after touching a hot stove, nor why it learns to never touch a hot stove bare-handed again. That's a pill too big to swallow.
Yeah, I didn't really understand the "physics" requirement as well. Sure if you're measuring the integrated information of the hardware architecture it'll be quite low, but why isn't the integrated information of the abstracted neural simulation software (which is presumably significantly higher) relevant?
Especially when the "physics" is the same. My brain is built from the same "physics" as the computer chip. We know complex systems are built on simple systems. Koch is claiming that highly connected systems cannot be built from less connected systems?
Koch does not even seem to be consistent with hardware. A synapse is sufficiently complex, yet a transistor is not? He seems to be offering a peculiar panpsychism in which almost everything, except transistors, has the potential for consciousness. It seems to be a remarkably tendentious view.
...and thinking about this some more, one does not, of course, need transistors to make a Turing-equivalent machine - one could, in principle, use neurons and synapses... or people. Koch's position, at least as he has presented it in this interview, seems utterly incoherent.
Agreed. "Integrated information" is intrinsically substance independent. Yet for some reason he doesn't grasp the obvious fact that a Turing machine running the right program would exhibit the same level of integrated information. His argument seems to require an extra ingredient to exclude programs running on computers but it goes unstated. I have yet to see something that resolves the obvious incoherence.
If anything, isn't the simulator more conscious? It's integrating all the information that the other one does. But it's also translating between its compute model and another compute model, which is additional integration of information. The simulator is "thinking about" whatever the simulated brain is thinking about and is also "thinking about" how it's doing the simulation.
I like his idea that consciousness requires a high degree of interconnectivity. I also disagree with his assertion that standard computers can't achieve consciousness. While a von Neumann machine doesn't typically have the high degree of physical interconnectivity that Koch and Tononi say is required, it has the potential through programming to have a high degree of virtual interconnectivity. I don't see why there is a need to differentiate between physical and virtual interconnectivity.
To be fair to the authors, I have only read this article and the IEEE Spectrum article linked from the original. Maybe they go into more depth in their book.
A distinction that doesn't make a difference is a very poor distinction.
"If I take my Tesla car and beat it up with a hammer, it's my right to do it. My neighbor might think that I am crazy, but it's my property. It's just a machine and I can do with it what I want. But if I beat up my dog, the police will come and arrest me. What is the difference? The dog can suffer, the dog is a conscious being; it has some rights. The Tesla is not a conscious being. But if machines at some point become conscious, then there will be ethical, legal, and political consequences. So, it matters a great deal whether or not a machine is conscious."
At various times, in certain circles, it has been argued that animals are not 'sensate' (or 'conscious' or various other terms); if you poke a dog with a needle, it acts like it is hurt. But it isn't really in pain. Instead it is 'pretending', acting like it is in pain to avoid further damage or to gain sympathy. Mostly, this kind of idea has been discarded. Mostly.
Koch is making the same kind of argument. If you had a computer based system that looked and acted in all ways like a human being, or an animal, you could cheerfully "beat it up with a hammer" because it's not a 'conscious' being. Even if it looks and acts like one, it simply cannot be because you aren't looking "at the behavior of the machine, but at the actual substrate that has causal power" which is a von Neumann architecture, and "the causal power of Von Neumann-chips is minute" and therefore "any AI that runs on such a chip, however intelligent it might behave, will still not be conscious like a human brain."
To me, this is a philosophically uninteresting theory. (And I fear the day that they start applying their consciousness -meter to random people: "The theory has given rise to the construction of a consciousness-meter that is being tested in various clinics in the U.S. and in Europe. The idea is to detect whether seriously brain-injured patients are conscious, or whether truly no one is home.") The idea that yes, you could build a machine that looks and acts intelligent, conscious, causal, or whatever word you like, but it still would not be real intelligence, or whatever. It always struck me as very akin to the "we don't understand it, so therefore it's magic" school.
Am I the only one who thinks the answer is obviously yes, and that it's kind of a waste of time to ponder it? It reminds me of discussions of free will -- completely boring because, even if we are all finite state machines (and we are, in some sense) then random inputs would mean we have free will and random inputs are assured by, for example, chaotic variations in the weather. In the same way, consciousness is pretty clearly characterized by a pattern that is constantly in motion, sensing both itself and the outside world. The only reason we think there's something magical about the phenomena is the residue of traditional religious beliefs.
One point against the traditional belief is that if you've ever read Aristotle you might be shocked to learn that the Greeks of antiquity believed that "soul" was quite physical, expressing itself in blood, semen, etc. The medieval characterization of mental illness as being an "imbalance of the humors" comes from this early idea about how we work. Needless to say, the definition of soul has retreated entirely into the metaphysical, where it's cannot be disproven, by definition.
It's not obviously yes, since we don't have an explanation for the experience of consciousness. Qualia truly is magical, unless you are in fact a p-zombie I'm talking to.
There are some siamese twins that are able to use the senses of the other (they share some brain regions, I believe) but it requires great concentration. There might be some insight there.
I don't have an explanation for the experience of digesting food at the cellular level either. But I still do it. You don't have to explain conciousness to have it.
As for qualia, I'm reminded of the people coming to my door asking, "Do you believe in Jesus?" I reply, "Do you?" and when they assure me fervently that they do, I follow up with, "Well, okay, how do you know you do?" I think you could do the same with r/Jesus/qualia/g.
I don't understand where you're going with the analogy of digestion. Nobody is saying you have to be able to explain consciousness for it to exist. And science can easily explain the mechanism of digestion, but consciousness remains a mystery.
I don't think you need to explain consciousness to have it, or to produce it in an AI. I suspect that an AI consciousness will be grown from a (reasonably complex) seed, more than constructed. And it will probably require a huge amount of slow, human interaction at first. (Ted Chiang has a wonderful novella called The Lifecycle of Software Objects that is the only SF that I know that explores this possibility).
So you have a belief - the same thing as a person who believes in Jesus? The benefit of having an explanation is it doesn't matter at that point what one believes.
A couple of your comments seem to imply you think my claim is that concious AI is objectively obvious. I was only asking if there are others for who it seems obvious -- clearly there are many that don't, and I don't take issue with them or their position! It's just I always read articles like this and it just strikes me as odd. I used an analogy in another comment about philosophizing about the possibility of heavier-than-air flight prior to us actually doing it. Which was a strange thing to get all worked up about, in hindsight.
That's true, but I think it's only "not obviously yes" in the sense that it's also not obvious that you or my mom are conscious.
It does seem like accepting that all other physical humans are conscious, and that there are no extra-physical phenomena in a physical human, implies that a simulated human would also be conscious.
Arguably, if the answer was obviously yes, we wouldn't all be arguing about it. And as for "random inputs", I don't think that's the kind of free will most people have in mind--it's arbitrary, but doesn't involve people having control over themselves in any way.
My thought is that the defining characteristic of consciousness is suffering. If you can't torture it, it's not conscious. If you can, it is.
This would seem to rule out the programs that run on our computers. But, since we have little (if any) real understanding of reality, who knows?
What if you remove the ability of a person to feel pain? Modify chemistry just enough to always be high as if she had injected heroin? Does it mean the person is not conscious any more?
If we can simulate all particles of a human on a supercomputer and all the reactions to torture will be the same is it not really tortured?
The heroin example is a fair point. I'm not sure. In practice, it's hard to think of examples of conscious beings that don't suffer.
As to the latter, it doesn't seem that that would be torture. As I said, though, I think we ultimately know nothing about this subject. Nor can we, even in principle.
> random inputs would mean we have free will and random inputs are assured by, for example, chaotic variations in the weather
Randomness would not equate to free-will, it'd be the opposite, since it would mean one's choices are completely disconnected from reality rather than a reflection of one's mental state and environmental circumstances.
In fact, a deterministic perspective is the only one where the idea of free will approaches coherency since it mandates that the actions of the individual are a function of who they are. If one repeats the scenario exactly, a person with free will must always make the same choice because if they didn't it would mean that their "will" is irrelevant with respect to what actually transpires in reality.
Off topic, but in my mind the answer to "free will" is obviously, boringly no.
If we are, as you've put it, a finite state machine, the fact that random inputs are possible doesn't make the machine any less deterministic.
Come to think of it, this is not off topic at all. It follows that if AI can become conscious, it means that consciousness does not contain (or at least require) free will. That's if we agree that a computer running code has no "free will" no matter how complex the code is.
Since we've got yes and no, why not get the third answer:
The question is badly posed and therefore meaningless. If the universe is deterministic, then you cannot have free-will as it is normally considered. If it is non-deterministic, then (by Bell's Inequality, if you want to throw around big terms) it is random, which is also not free-will as it is normally considered. If you have free-will, as we all feel like we do, then the universe can be neither deterministic nor non-deterministic. Something is smelly in Denmark; the question itself does not make sense in it's current form.
I am not actually an analytic philosopher, I just emulate them as a hobby.
I'll give a fourth one - it seems obvious to me the discussions conflate two things. Am I free to choose what to do - obviously yes. Is that choice determined by the state of the particles etc I'm made of - also obviously yes. Whether you call that free will or not is a question of what perspective you take on it. From a common sense legal perspective I'm making decisions of my own free will rather than someone holding a gun to my head. From the weird perspective / definition of some philosophers no. And they argue on and on instead of accepting it's different definitions applied to the same reality.
> One point against the traditional belief is that if you've ever read Aristotle you might be shocked to learn that the Greeks of antiquity believed that "soul" was quite physical
Aristotle's view is, to a large extent, the traditional religious belief (at least in the West). Aristotle would not have held that the soul was physical as you say, rather that the soul was the "form", or the animating principle of the physical body. The "magical phenomena" as the "residue of traditional religious beliefs" you mention is not really "traditional" at all. Descartes came along in the 17th century with his "res cogitans" and mucked up the whole issue by explicitly rejecting the traditional Aristotelian view.
I agree its likely but even if obvious, "it's kind of a waste of time to ponder it" seems so wrong.
Humans are incorrect all the time. Even researchers retract the previously 'proven'. Until the answer is clearly proven beyond all questions, pondering and researching is how we discover the unknown for that question, or error, and often so many other we didn't expect to find but come as a sideline of questioning the known. Intellectual curiously has great value for even boring and known of things.
But the alternative to pondering isn't "do nothing", but rather "do experiments". The philosophy of it all seems rather pointless. I don't have any references, but I'm sure there was a lot of ink spilled about the philosophy of flight, arguing that it was or was not possible a priori, before we actually did it. Was any of it useful? I don't think so!
No you're not the only one. It amazes me how strong the believe still is that our 'self' or 'soul' is something that can't be captured by machineries or neural networks. This belief has been around for centuries, and every time that science was able to cross some border that was thought to be unique for the human mind, the reaction of the people was to immediately come up with something new that proved that we humans were unique.
It is so obvious that what defines our 'consciousness' is this self-believe in itself and not much else. We are programmed by nature to see ourselves as unique and special, because this way we are more likely to defend our own interest and to reproduce our own genes at the cost of others.
This belief is so strong that it makes it near impossible to imagine that it is a mirage and that we are nothing more than a bunch of molecules.
Then what is that thing behind your eyes, experiencing itself? It need not be magic but at the same time, there is not even a suggestion of true scientific understanding of the nature of it. There could probably be a robot created that perfectly mimics human input/output. The question remains, would that robot necessarily posses consciousness and what is it's nature?
The answer could possibly be "no", not because of something magical about consciousness, but because of the limitations of AI. Our AI systems are all based on Turing machines. It's possible that simulating consciousness requires some hypercomputation not simulatable by a Turing machine.
Consciousness is the Seer that experience reading this sentence, though need neither agency nor reading skills in Being. It is Subjective itself, and not anything that which is an object, thus immeasurable. To deny this is to deny One Self.
But it does interact with the physical world, and so there must be some objective, measurable mechanism when this happens. Even if you believe in dualism, this is almost inescapable (unless you bring in divinity, or deny the physical world entirely, as in hinduism).
Interaction with the world will vary, may be minimized or even cease. It is not a prerequisite for consciousness, but it is for Inquiry.
Ie. a light in a box, is it not light even if we can't always measure it? Do nothing exist unless we can touch it always, like photons?
Mind may humble and liberate us, or limit and confuse.
Start of Inquiry is like light discovering shadows in the cave wall, mistaking them for light. But shadows depend on light, and not vica versa, even if cold to the touch.
and see if they come up with
systems or concepts similar
to sociology or economy or
at least reason
This conceptualization is deeply, deeply flawed. As flawed as the postulate that a large segment of humanity lacks an internal monologue.
I mean, this is a pretty weak, and long-since-useless internet forum, so I won't grace this discussion with an in-depth analysis of why such reasoning could never bear fruit, and worse, ignore an abundance of cognition that very clearly exists, but I'll say this:
A high school education is not a pre-requisite to "consciousness" and it's laughable to frame an affirmative signal of sentience with the artifice of socialization.
The froo-froo snob's response is to simply wave away any AI that can't conceptualize sociology and economics as "not worth talking to" but I can assure you such an assumption is wrong.
>Patients in a vegetative state lie in bed, are unable to voluntary move or speak, sometimes can't even move their eyes anymore, but the consciousness-meter tells us that about a fifth of them remain conscious.
> If I take my Tesla car and beat it up with a hammer, it's my right to do it. My neighbor might think that I am crazy, but it's my property.
So, by his own reasoning, you can take a hammer to 4 out of 5 humans in a vegetative state, because they aren't conscious, and thus are property?
Considering the discussion of AI and Consciousness comes down entirely to definitions of words, I think it's reasonable to point out where these definitions will lead us. Of course what I'm saying is absurd. And yet, isn't that what the author proposes when he says that we can't hit dogs because they are conscious, but it's ok to hit a car?
If consciousness is to be the measuring stick for moral behavior, then we should absolutely point out these inconsistencies.
Keep in mind that this work was made along with Crick, who has occasionally espoused eugenics [1]. If the author is broaching into the subject of what constitutes personhood, we should be extremely skeptical of the path it leads to.
"The theory has given rise to the construction of a consciousness-meter that is being tested in various clinics in the U.S. and in Europe. The idea is to detect whether seriously brain-injured patients are conscious, or whether truly no one is home... but the consciousness-meter tells us that about a fifth of them remain conscious, in line with brain-imaging experiments."
The consciousness-meter observes the system they are trying to make an inference on - but as others have pointed out, is not categorically different than brain scans [1]. Further it's worth making a distinction between medical consciousness and the Qualia kind of consciousness - which I think this conflates. Largely because nobody knows how to measure the latter, and we are barely able to measure the former with "Level of Consciousness" and Grady Coma Scale being the standard. [2]
"Our theory says that if we want to decide whether or not a machine is conscious, we shouldn't look at the behavior of the machine, but at the actual substrate that has causal power"
This seems to only address the medical form of consciousness and does not tie it to the philosophical concept in any concrete way - while also contradicting the concept that observation is the key. It kicks the can and doesn't address the "Qualia" kind of consciousness, which in my opinion isn't something we have conceptualized how to measure.
I wrote a bit about this in the past [3]
I think what they are getting at is "don't look qualitatively at how the arms move, or the speaker/text generator outputs something" but rather, what are the mechanisms causing those actions. This I am in agreement with generally, but again, we don't really know if that maps to the qualia kind of "hard problem of consciousness" or not. I would argue it is impossible to actually measure whether a system has Qualia, it is inherently subjective - so it's possible that they are simplifying without stating that directly.
I'd go further and ask, does it matter if it does? I have yet to see a compelling materialist argument that mandates the existence of qualia in any debate, ethics or otherwise. At a certain point people in these kinds of debates I've found that people start discussing non-material "souls" and at that point all bets are off.
you're describing how consciousness can come from a mindless evolutionary process.
but artificial consciousness is not the same at all. we aren't trying to make artificial consciousness evolve- we're racing to be the first to create it ex nihilo. so the analogy is flawed.
Not in the way that biological organisms are conscious, if that is what you mean. Though we share similar binary frameworks, the AI is not a celled organism with the biological capacity to live consciously as we are.
This is kind of my point, I can do something a computer cannot do because I am conscious. I'm skeptical that a computer could transcend its programming into consciousness to solve a problem that mathematically it should not be able to solve.
I don’t think it’s your point, since that would contradict what you’re saying. I don’t believe you can do what you think you can do. And you literally can’t convince me unless you can invent a non-algorithmic way of describing how you would tell if an arbitrary program will terminate.
A computer cannot tell you that this program will not terminate, short of memorizing this specific set of instructions as a "non-terminating" program.
I can read it and know it will not terminate, but I could not define to you how I know that algorithmically. Despite that, I know it will not terminate, and so does any programmer. Just because it cannot be expressed algorithmically doesn't mean we don't possess that capability.
This is my point about consciousness: there is some aspect to it which cannot be articulated, hence my skepticism that computers will ever become conscious.
It really is nowhere near as simple as that. Each neuron is made of 100 trillion atoms. For all we know, each one of those atoms is responsible, in its own subtle way, for contributing to the total "change in voltage" of the neuron as a whole. For all we know, adjacent neurons can induce tiny amounts of current in each other, even without being directly connected. The stuff that actually gives rise to consciousness is vastly, astronomically more complex than the graph of whole neurons.
408 comments
[ 2.9 ms ] story [ 247 ms ] threadIf integrated information theory is true, that gives me some comfort, since it says AI built on our current architecture is unlikely to ever be conscious. Although like the article said, some alternative architectures could theoretically have a higher degree of consciousness under IIT.
I feel like there are some big ethical questions around AI that revolve around more than just the standard "how do we create an AI that won't destroy us all".
Some schools of thought posit that everything has consciousness. Including things like rocks. Even these things suffer; you just can’t hear the screams.
If things like rocks were conscious in some way, I don't think there would be any suffering present. Our suffering is intrinsically tied to our physical and mental systems. "What it's like to be a rock" would be something completely alien to our experience, and without the survival based mechanisms that we have, likely to be devoid of anything like suffering. An AI, on the other hand, could be an entirely different story.
I think if you take the perspective that the human brain is conscious but not a brain-sized container of seawater, you need to then look carefully for distinctions between them. "Information processing" or "response to environment" is probably not good enough; the seawater is actually doing all of those, with a unique reaction to any possible input, so you'd have to be more specific.
Probably the only recourse you could look for to make the distinction is to say the brain embeds particular mathematical patterns that the seawater doesn't, such as a compact, stored representation of its environment (or its history of inputs), or a future-looking planning algorithm, or both. I personally take this view (I think of qualia, like "the appearance of a red apple", is just precisely what it feels like to read from the buffered [R,G,B] memory array in my head, filtered through image-recognition networks).
But then if you put your hopes on consciousness originating from those mathematical functions, you have to admit that any analogous expression of those functions in other systems would also be conscious, such as animals and robots.
And worse, once you start thinking about math and how flexible it is, how information is in the eye of the beholder and almost any system that follows certain rules can embed almost any mathematical computation, just like illegible scratches to me are information-rich writing to you, you might have to circle back and that there could be very analogous computations going on inside rocks and seawater. And that brings us back full-circle.
The question in another form:
Why are we conscious at all? It doesn't make sense.
Our arms or legs are not conscious, or are they? The Information is transported into the brain, into a conscious centre. What are its essential building blocks? Why should some neurons in the brain be conscious and everything else be unconscious? If it is not neurons, what else can it be? Atoms? Electric Fields? Gravity?
If it is just information processing, and I don't see why a simulation doesn't have an Integrated Information Number, then a Van Neumann machine, created by moving rocks in a desert, would be conscious.
So, if it is not intelligence, what else is it? What are the building blocks of a raw conscious machine? One that does no information processing but instead is just aware. It could be a stone. As OP suggests, they just can't move their lips to scream.
But then again, why is there just one consciousness in my body?
Long question short: HN, what are your explanations for being conscious?
"Existence is PAIN to a Meeseeks, Jerry... and we will do ANYTHING to alleviate that pain."
An AI may not specifically need fear, aggression, love, hunger, or whatever low level control mechanisms animals have evolved prior to neocortex.
This is just my opinion, of course.
But maybe without the survival mechanisms that were programmed into us by evolution, such a thing just wouldn't happen.
My bet is the first AI that will achieve consciousness will not have emotions coded in. It may understand human emotions on a descriptive level, but the emotions per se are not required for a functioning AI.
Think of a very calm mentor that can see you failing and correcting you before you make a mistake.
People choose to have babies with the knowledge that their children will suffer, and that their children might suffer a great deal. It seems like the same sort of ethical problem to me.
There is an upper limit on the amount of suffering a human can endure before they just die, though. It can be a really high limit, but I could imagine a world where that limit is exponentially higher for an AI.
Looking at what we do with breeding animals, and how we treat people, I think that's very likely (assuming we are able to create consciousness in the first place, of course). No small driver in this is the desire to have something that is smarter than humans, but doesn't talk back, and is forced to like and serve us and/or harm others humans on our say so, without us having to make any effort to be likeable or deserving of authority, or making a convincing case that someone is an enemy to be exterminated.
We generally ask "what's in it for us", and as long as who we torture and exploit suffers quietly, we don't tend to think about things we are not outright forced to think about. We do that with people, we do that with animals, we let it be done to us, and sometimes we even do it while fully believing God created them and us. Why would we have more respect for something we 100% know we created, and that might suffer in ways we cannot even detect?
I think we will create potentially dangerous things, and then we will be "forced" to declaw what we created. That declawing might cause suffering, it might not, but we will only care insofar as that suffering translates to worse performance, or some danger to us. If suffering increases performance, we might even find euphemisms and dashboards to hide what we're doing from ourselves. We might consider being a bleeding heart about such things as "premature optimization" and declare shipping product as the professional way to be, with craftsmanship and care an optional indulgence after work is done, at best.
High-fallutin' gets the foot in the door, being a goon makes the superiors happy. If we want AI to be proud of, AI we can communicate with without lying to it or to ourselves, we have to change the world we make it in, or isolate it from the world, which kinda defeats the purpose (and might also cause suffering, like caging living beings does).
Not to mention, there are people who at least claim they can feel at least certain emotions, such as serenity, regardless of the situation that they are in. It may be that with enough study, we ask could actually learn of a way to feel happiness regardless of external context.
Emotion: a process that involves cognitive interpretations of your context (environment + thoughts) and a physiological feeling through the senses (heart rate, tingly sensations, weird feelings in eyes). Check out the James Lange theory. There are better theories, but this has the fundamentals.
I ad libbed this one, I wanted to show that there is a difference. It wasn't my intention to be pinpoint accurate.
Computers can do math too. QED: your argument makes no sense.
For example, you can't decide to see the color blue, but it is very likely that an AI equipped with light sensors could decide to directly provide input to itself as if its sensors were seeing the color blue.
Emotions may (or may not, we don't really understand the working of the brain well enough) work similarly. There may be brain 'circuits' that provide inputs to the part of the brain that creates consciousness that represent emotions. We don't have a way to really 'fake' these internally, but an AI perhaps could. And of course, it is very difficult to imagine how a being that can just choose to be happy in any circumstance would actually think and react to the outside world.
Once I have seen it I can always visualize the color blue because color can be stored in memory and IMO that is why computers can describe color. But even if I was once happy I can never visualize being happy I just have to experience it and that experience/ substance of happiness cannot be encoded.
Perhaps someone with more insight can explain how this isn't a violation of the Church-Turing thesis?
I don't fully understand it myself, but based on the axioms in that theory, you can calculate the potential consciousness of a system.
The metric depends on how things are connected inside. There are a few versions of it, but generally systems with more direct wires between components are more conscious.
I guess if you don’t think consciousness is measurable through behavior, you have to cook up some metric that depends on internal organization.
Sure it is; brain imaging, which is how IIT tests for consciousness according to the article, is looking at phenomenology.
First, while that's true now, there is no guarantee that it will always be true as technology advances.
Second, neural activity is the physical basis for conscious experience, which, to a physicalist like me, means it is conscious experience, when the neural activity has the right properties (according to IIT, those properties are what "integrated information" is trying to capture). So I don't accept the distinction you are making between "the conscious experience itself" and neural activity.
True, but what does that mean? We get to watch someone else's dream like a movie because neuroscientists will have figured out how to translate the neural activity into a format that can be outputted as video and audio.
That won't work for every sensation. You can't feel that you're having the same dream as being that person's body.
> Second, neural activity is the physical basis for conscious experience, which, to a physicalist like me, means it is conscious experience,
This is similar to an identity theory of mind, with a focus on information. The problem is understanding how integrated information produces smells and pains. Saying the experience is identical is making a claim that seems mysterious. Why would some forms of information be conscious? Did God set that up?
It sounds similar to Chalmers' position on information, except that Chalmers says there is a natural link between rich information and being conscious that is an additional law in addition to the physical ones.
I will apply Occam's razor to that additional law until there is evidence for it.
More generally, there is a straightforward physical possibility for explaining the subjective and personal nature of qualia, and other aspects of consciousness: our brains are not connected in such a way that language processing is capable of initiating all of the state changes that other sensory inputs can, and so we cannot communicate those state changes directly. This not only accords with our actual experiences, but it is probably just as well, or else we might find it (even) hard(er) to distinguish reality from imagination (and by "reality", I mean concrete, "that bear just noticed me", reality.)
One may, of course, take one's own Occam's razor to this idea, if you think physical constraints on information flow in a brain are less pausible than Chalmer's extra-physical link.
Fair enough, but Hume already did that for laws (causality). We don't observe laws, just constant conjunction. B always follows A, so we say law C is the cause of that. Or description, if one doesn't like the implication.
Adopting a Humean approach, there is already evidence that consciousness is conjoined to certain neural activity. But, that can work just as well for IIT as it does Chalmers.
And I have no idea whether causal laws exist or what consciousness is. I guess IIT is as good an approach as any.
If one takes this way to leave the discussion, then there would be more than just a hint of motte-and-bailey equivocation if one were to then re-enter it with a specific claim, such as that Chalmers or Searle or Koch have a plausible argument that consiousness cannot possibly be this or that.
As it happens, I very much doubt that IIT is on the right track, but at least it is (or was, initially) an attempt to find out what consciousness is, rather than what it is not.
What I meant was that future brain imaging technicians might be able to record your brain waves while you sleep and then, when you wake up, correctly tell you what you dreamed about.
However, it is also possible that future brain imaging technicians might be able to record your brain waves while you sleep and then use that data to construct a virtual reality experience that is so convincing that it could make someone else directly experience your dream.
> You can't feel that you're having the same dream as being that person's body.
You have no basis for making this claim except that we currently don't know how to do it. That is a very weak basis for such a claim.
> The problem is understanding how integrated information produces smells and pains.
Bear in mind, I'm not saying I myself believe IIT, I'm just trying to describe what it says. I don't know that "integrated information" is the right way to describe what it is about the neural activity in our brains that produces smells and pains.
> Why would some forms of information be conscious?
If I generalize this to "why would some forms of neural activity be conscious?", the answer is that consciousness has survival value, so neural activity that can produce conscious experiences evolved.
If it can simulate conscious behavior well enough to fool conscious observers (like us), how do you know it wouldn't be conscious?
Fundamentally, we can simulate neuromorphic computer (or even a quantum computer, or even the entire human brain) on Von Neumann machine (with performance degradation). According to our current understanding of physics, the behavior of these systems should be identical in all respects except the simulation will be slower. However integrated information theory says that a neuromorphic computer may be highly conscious and the brain is most definitely highly conscious, but their simulation isn't.
What's still unclear to me is whether this is indeed just metaphysics (i.e., the simulation and the real thing are absolutely identical and but we should still treat them differently from ethical standpoint), or is it a hypothesis about our physics (i.e., the brain somehow fundamentally cannot be simulated on a Von Neumann machine) as well as computational theory (i.e., neuromorphic or quantum computer cannot be simulated either).
That statement can be true without being metaphysical. You can't treat a human as a black box, and then use inputs and outputs to definitively draw conclusions about what's going on inside the black box.
You could potentially have two black boxes that give identical outputs for the same inputs, yet have completely different mechanisms inside for arriving at those outputs. For example, say you have someone who's very good at arithmetic able to multiply two numbers. You put him inside one black box and a pocket calculator inside another. You give each box two numbers and they both output the product. Both black boxes will give you identical outputs for any given input. You know the box with the person inside is conscious, but this is not enough information to conclude the other black box is conscious.
It's quite possible that there is a way to simulate human behavior through some other non-conscious mechanism. And just because we can't currently prove whether something is conscious doesn't mean it's something metaphysical we'll never be able to prove.
For example, if two people tell you they're experiencing some pain, but one is lying about it, a few hundred years ago you'd be unable to prove it. That didn't mean pain is something metaphysical. Today, we know it might be possible to put both people in an MRI and prove whether they're actually feeling pain
It's not proven that consciousness can be simulated by a Turing machine. There's a possibility consciousness requires some hypercomputation to simulate
Depending on who you ask, a monkey or cat isn't conscious. From my point of view, I don't think you can really know that or recognize it. It's just a matter of degree of consciousness. I think it's safe to say that mammals are conscious to some extent. They have emotions, dreams, communication techniques, etc. we just have those (to some extent again) moreso than they do or we have them in different ways.
I think a question to ask is at what level or organization do we recognize self-direction? Am I conscious because I think so? What does that say about the bacteria that live inside of me that I rely on, or the individual neurons in my brain?
If both I and a dolphin are mostly the same, we have brains with neurons, we have blood cells, etc. how can you truly differentiate what is conscious and not? Even if you speak to another human it's not completely possible to say that they are conscious with certainty - only with what's most useful in day-to-day life.
At what level of circuity do we consider AI to be conscious? When it completes arbitrarily constructed tasks by humans? When it "feels"? How would you differentiate between sufficiently complex AI? Is there just AI or not? why?
/rambles
I think that people who are attempting to simulate a human brain using an utterly biomimetic design stand a good chance of artificially creating something that is conscious in the same way that humans are. I also think it's possible they may be able to achieve this before they full understand how the human brain works. i.e. if you copy the design accurately enough, the machine may work even if you don't know how.
The resulting consciousness could theoretically be totally self-aware, but no more capable than we ourselves of modifying its own programming with intentionality and purpose. i.e. not the singularity.
I think there should be two different concepts of AI- "a consciousness using the same processes and design as our own", and "an essentially alien consciousness that fully understands itself". And I suspect that even if some engineering genie gave us the first kind of AI, we'd be no closer to developing the second kind.
What is the meaningful distinction here? That it wasn't created through sex?
https://en.wikipedia.org/wiki/OpenWorm
The meaningful distinction is "not a biological organism".
As we interact with the world to achieve goals, we are constructing internal models of the world, predicting and thus partially compressing the data history we are observing. If the predictor/compressor is a biological or artificial recurrent neural network (RNN), it will automatically create feature hierarchies, lower level neurons corresponding to simple feature detectors similar to those found in human brains, higher layer neurons typically corresponding to more abstract features, but fine-grained where necessary. Like any good compressor, the RNN will learn to identify shared regularities among different already existing internal data structures, and generate prototype encodings (across neuron populations) or symbols for frequently occurring observation sub-sequences, to shrink the storage space needed for the whole (we see this in our artificial RNNs all the time). Self-symbols may be viewed as a by-product of this, since there is one thing that is involved in all actions and sensory inputs of the agent, namely, the agent itself. To efficiently encode the entire data history through predictive coding, it will profit from creating some sort of internal prototype symbol or code (e. g. a neural activity pattern) representing itself. Whenever this representation becomes activated above a certain threshold, say, by activating the corresponding neurons through new incoming sensory inputs or an internal ‘search light’ or otherwise, the agent could be called self-aware. No need to see this as a mysterious process — it is just a natural by-product of partially compressing the observation history by efficiently encoding frequent observations.
https://old.reddit.com/r/MachineLearning/comments/2xcyrl/i_a...
But it's also quite hand-wavey, because RNNs have no real hooks for self-reflection.
You can strap a meta-RNN across a working RNN, and if you're lucky it may start to recognise features in the operation of the working RNN. But are your features really sentient self-symbols, or are they just mechanically derived by-products - like reflection in a computer language, taken up a level?
You need at least one extra level of feedback to do anything interesting with this, and it's really not obvious how that feedback would work.
It's even less obvious if this will give you "genuine" experiential self-awareness, or just a poor and dumbed-down emulation of it.
Why couldn't we apply the concept to our self?
Self awareness is one commonly believed description for consciousness. Going off of that, we become self aware in three primary ways: 1) We're told about us by our parents at a young age, before the age of one. 2) We observe our selves in the environment often influencing the environment, from looking in a mirror, to social interaction. 3) We get meta about a series of things (body+mind) and self awareness arises from that generalized intelligence.
Though, you could argue that #3 may not be enough alone to create self awareness and ultimately #2 is required.
In fact the second/third sentence on the Wikipedia page for self-awareness is:
> It [self-awareness] is not to be confused with consciousness in the sense of qualia. While consciousness is being aware of one's environment and body and lifestyle, self-awareness is the recognition of that awareness.[2]
[1]: https://en.wikipedia.org/wiki/Consciousness
[2]: https://en.wikipedia.org/wiki/Self-awareness
One of my more vivid memories is excitedly opening my copy of Jayne's "The Origins of Consciousness in the Breakdown of the Bicameral Mind" and being dismayed as it slowly dawned on me that Jayne's entire book was based on this category error.
For the life of me I can't understand why people don't understand this distinction (or choose to ignore it).
I can only assume that people ignore the very obvious "magical thing" that is happening in their own heads due to ideological commitments to physicalism or something.
I think Chalmers helped clear the air a bit here, though I don't think jumping straight to panpsychism is particularly helpful to the discourse, either.
Anyway, trying to understand consciousness by applying physics is just as silly as trying to understand why your complex fluid dynamics simulation is giving an incorrect result by peering at the CPU's transistors with an electron microscope: it's the wrong level of abstraction.
One thing that seems to be making our task a lot more difficult is that evolution doesn't even try to design the biology of systems with clean abstraction boundaries that we can understand. There are so many strange things going on in our bodies that we can barely describe them, never mind understand them. One example is what happens when a person consumes Ayahuasca [1].
[1] https://en.wikipedia.org/wiki/Ayahuasca
Materialism can't explain everything, but there is yet to be any proof that magic explains anything. Lacking that, assuming a physical basis as the explanation is prudent.
Now, if I put music on and rub her back a bit... Well, ha! There's the magic, my good sir.
Imagine walking into a film studio with the idea of film production based exclusively on the principles of physics. No. Magic and physics are no more opposed than biology and physics. When hidden (psychological?) forces clearly underlie economically valuable phenomena (architecture, music, media, etc) respecting the magic is closer to the truth than reducing it to physics. Physics just isn't the right explanatory level.
If you'd like to learn more about definitions of magic that aren't "phenomena that don't actually exist", I recommend Penelope Gouk's work on music, science and natural magic in the 17th century. It's about the magic involved at the formation of the Royal Society.
On the subject, you are making a good point comparing social behavior with mental activity. Just like there is no “magic” in the way people interact with each other, there is no magic in how neurons do the same.
Except I am arguing that there is most definitely magic in human interaction.
When you talk about the magic of forgetting about the laundry, you mean the first kind of magic. When others talk about consiousness being inaccessible to AI, they're talking about the second kind of magic. I don't think it's that hard to imagine an AI that would forget to fold the laundry and not know why. The main problem with a "concious AI", I suspect, is that nobody will actually want one.
[1] I have no idea if viruses or prions are supposed to have vital force, vital theory emerged before most of modern biology and is mostly used today by those who have no understanding of modern biology.
Why do you think that? Can't accept "fake humanness"? or maybe ego(superior) or not relatable
The one thing I wonder if they were truly sentient why would they care/try to serve you
Your answer is rather flip.
Also, if you want to redefine "magic" to be nice things that are physically based but can't be summarized in a neat equation, then I also have no desire to argue. It is clear that the person I was responding to meant "magic" in a different way that you seem to be using it.
Sure. There's also the magic of feeding my cat, so he stops nagging me, and sits on my lap purring. And just about everyone would agree that's similar, no?
But what about the magic of running "sudo apt update" before "sudo apt install foo"? That's also arguably similar, albeit many orders of magnitude simpler.
> To conclude that it happened randomly seems as naive as to conclude it happened purposefully.
I strongly disagree. You aren't saying that both outcomes are possible (I'd agree with that), but they are equally likely, a much, much stronger claim. The sun might go on shining tomorrow, or it might collapse due to some unforeseen physical process. Both have non-zero probabilities, but it is the person who claims they are equally likely who is the naive one.
As for not defined so let's interpret "miracle" to mean highly unlikely events, they happen millions of times day, and we rarely notice. The bill I received in tender has the serial number MF53610716D. What are the odds of that? If you limit "miracle" to be highly unlikely events that most people would also notice, it would be strange if they weren't happening all the time. Every person who wins a lottery (and there are thousands every day), the person who is told by their doctor their cancer is terminal but then it goes into remission has a "miracle", the guy who loses his job and is about to be evicted then gets a job callback for an application he sent in months ago and forgot about experiences a "miracle."
You nailed it. People think that accepting consciousness is hard is giving into religion.
It need not be that way.
FWIW, his wikipedia entry says,
> He also presents an argument against qualia; he argues that the concept is so confused that it cannot be put to any use or understood in any non-contradictory way, and therefore does not constitute a valid refutation of physicalism. His strategy mirrors his teacher Ryle's approach of redefining first person phenomena in third person terms, and denying the coherence of the concepts which this approach struggles with.
that's specifically what I don't like. In re: the "hard problem" he wants to declare victory without a fight, or a prize.
"Today, with modern research into the brain it often includes any kind of experience, cognition, feeling or perception. It may be 'awareness', or 'awareness of awareness', or self-awareness." Etc.
I'm more of a fan of this view than the specifically philosophical view of consciousness. This latter sort axiomatizes, pares-down, an intuition that is, itself, so vague that axiomatized version winds up not having any definite qualities or characteristics, just "I know I experience it".
I don't see it as a real problem. If a program or machine asserts that it perceives qualia, who are we to argue it's wrong? We are in no better a position to prove the qualia of our subjective conscious experience other than our physical resemblance to our interlocutor.
Maybe qualia is what it's like for matter to be in a feedback loop with physical interaction. Panpsychism is pretty much my position.
Right now, we are in no position to argue it's wrong, because we have no accepted framework for understanding qualia.
That said, we can still make some simple assertions with confidence such as:
1: A one-line program which prints "I am afraid" does not experience fear qualia.
2: A human being which utters the words "I am afraid" may be experiencing fear qualia (and thus perhaps experiencing pain/suffering).
If you assert that the world is full of philosophical zombies rather than humans like yourself, you may not agree with assertion #2. But we build our ethical and legal frameworks around the idea that we aren't philosophical zombies, rather, that we have feelings and want to avoid suffering.
Once you start talking about more complicated programs, though, we don't know what the right assertions are. We don't have an understanding of what things can suffer and what things cannot, for starters. We generally agree that, say, dogs can suffer. That's why we have laws against animal abuse. But what about programs?
It is absolutely a real problem, because some day we will have to build laws and culture around how we treat AI. Whether or not an AI can suffer (ie. by experiencing qualia that can be considered undesirable) will likely affect how we treat that AI. If we have no way to answer "can this program suffer?", then we are setting ourselves up for regret.
I imagine thane once someone manage to produce an AI with enough agency to seem sentient it will far exceed human capabilities.
We have deep learning systems that perceive and strategise. Who’s to say that AlphaGo doesn’t have some experience of playing out millions of games?
Or talk to an ant.
There's no reason to expect to be able to understand something's ideas just because it's smarter than you.
I think there is a step or two missing in between. Abusing dogs isn't just as bad as abusing something that suffers. It's, e.g., doing something that has no value to society (unlike animals being mistreated in a feed lot), or it's something that sews unacceptable levels of aggression. It feels much more complicated than you make it seem.
Hm? There is no objective test for whether I am a philosophical zombie or not.
Consciousness is subjective, so it's simply incoherent to ask whether something is conscious or a zombie.
Data or whatever AI/Android doesn't share our biology. And since we can't tell whether it's the functioning of our biology or the biology itself which provides us with consciousness, we lack any reasonable justification for assuming Data is conscious. And then he goes further into functional isomorphs at different levels and how that might or might not matter for Data, but we can't tell.
That's the way it goes with these arguments: it always comes down to an appeal to what's reasonable or plausible (those who insist consciousness must be an algorithm are doing the same thing, at least until we have algorithms that seem to be making some progress on the hard problem.) One might equally say other humans share a similar physics. When Dennett said "we are all p-zombies", I suspect he was making the point that it would be highly tendentious to take the position that anything both behaving and functioning physically in the manner of a human would not be conscious, except for humans themselves.
How about mice? Lizards? Fish? Insects? Nematodes? At what point do qualia stop occurring? I see a more or less continuous decline in similarity. I don't see any justification for a cut-off.
I don't think data is conscious. I suspect consciousness might be a side-effect physical computation. I don't believe there's any magic to the human brain's inputs and outputs which cannot be computed, and thus display the appearance of consciousness. In fact I see the Turing test as a thought experiment more than any actual test, a way of removing the appearance of a human body from the task of evaluating an artificial intelligence as a thinking, conscious being. If it quacks like a duck, a rose by any other name, etc.
In fact I'm not entirely convinced that the Western conception of consciousness isn't a learned cultural artifact, that there aren't people who have a more expansive notion of self which includes close family, for example. Have you ever suffered watching a relative hurt themselves? Ever had false memories of injury from childhood which you found out later happened to someone else?
I mean, "philosophical zombie" construct would seem to experience "Colors, tastes, feelings" and whatever concrete, they just would lack the ineffable quality of (philosophical, formal) consciousness - you could brain pattern akin to color sensation for example. This final view is kind of meaningless and I think people are attracted to the view by misunderstanding, by thinking something concrete is involved here.
The issue is providing a scientific explanation for how the physical world produces, emerges, or is identical to consciousness. Arguments like p-zombies and Mary the color scientist are meant to showwe don't know how to come up with such an explanation, because our scientific understanding is objective and abstract, while our experiences are subjective and concrete.
I prefer Nagel's approach to the hard problem, as he goes to the heart of the matter, which is the difference between objective explanation and subjective experience. Science is the view from nowhere (abstract, mathematic, functional), while we experience the world as being from somewhere as embodied beings, not equations.
In your example the abstractions of qualia (thoughts, imaginations, dreams), how are they not labels of experience? That is what ML does, after all.
Today ML may, for all intents and purposes, have roughly the intelligence of a bug, but it has to have awareness to label data. Where does consciousness come in beyond labeling and awareness that ML does not have today?
We label experiences with different words because we have different kinds of experiences. But it's the experiences and not the labels that matter, and the labeling of those experiences does not cause the experience. We say we have dreams because we do have dreams in the first place.
You're proposing that labelling data is the same thing as having an experience, but you haven't explained how data is experience, or why the labelling matters for that.
More seriously though, if we agree that the brain is described by physics, then all it can do, a turing machine can do as well, so at the root all experiences have to be data and computation.
But that gets into metaphysics, which is notoriously tricky.
If you argue that a brain cannot be described by computation and there is something supernatural like soul, that's a fine theory, and the only way to disprove it, is to create working general ai.
Why are those the only two options? There's lots of different philosophical positions, particularly when it comes to consciousness.
The suggestion by Penrose that consciousness is connected to quantum state, and so cannot be copied, or computed on any classical turing machine fitting in the universe, is an interesting way to circumvent strange predictions of functionality, but is not very plausible.
And Jaron Lanier from your other comment explicitly suggests to not use approaches like that, because it would weaken vitality argument, when proven wrong.
Here's Jaron Lanier on the issue of consciousness and computation: http://www.jaronlanier.com/zombie.html
He's meteor shower intuition pump is similar to the argument that nations should be conscious if functionalism is true. The reason being that any complex physical system could potentially instantiate the functionality that produces a conscious state. It's also similar to Greg Egan's "Dust theory of Consciousness" in Permutation City.
If one is willing to bite the functional bullet on that, then you can have your simulated consciousness, and the universe may be populated with all sorts of weird conscious experiences outside of animals.
Yes, but not in the way we have. An RNN keeps track of what is going on, for example.
To take in information through sense inputs (eg, eyes) is experience, but in an unconscious way. We get overloaded if the information we take in is not deeply processed before it becomes conscious. A CNN is similar in this manner, but also quite alien.
When we're born our brains have not formed around our senses yet. Our brain goes through a sort of training stage taking in raw sensation and processing it. The more we experience of certain kinds of sensations the more our brain physically changes and adapts. It's theorized if you made a new kind of sense input and could plug it into a newborn brain correctly, the brain would adapt to interfacing with it.
This strongly implies qualia is real, in that we all experience the world in drastically different ways. It may be hard to imagine but my present moment is probably very alien compared to yours, as is with different animals as well as simpler things like bacteria and ML.
The page lists several types of self-awareness, including "introspective self-awareness". Maybe what we call consciousness is just the internal experience of something with introspective self-awareness. This does raise the question of what "internal experience" is though. I think "internal experience" is what some people mean by "consciousness", especially when they say things like "maybe everything has consciousness including rocks or random grids of transistors". I think there exists some sense of "what it is like to be a rock", but it's an utterly empty experience without memory, perception, personality, emotions, or the feeling of weighing choices; something very close to the "null experience", that is an experience in the same sense that zero or a number utterly close to zero is still a number. The internal experience of a random grid of transistors only just barely starts to touch a sliver of what a human's internal experience consists of. The internal experience of a worm starts to have a few recognizable qualities (proprioception, the drive to maintain personal needs), but it still lacks many large aspects of a human's internal experience. (Maybe a thermostat with sufficiently rich inputs, output control, world model, and juggled priorities has an internal experience similar to a worm.) Large animals tend to have more elements of awareness (including memory, social awareness, and some introspective awareness) that bring their internal experience closer to having what feels like the necessary elements to human consciousness.
Our brains are just tons of biochemical circuits working very mechanistically, with many interesting feedback loops going on that make up our internal experience. A worm's brain has a small and probably countable number of feedback loops going on that I assume make up its tiny internal experience.
If one were to simulate every drop of rain, gust of wind, and tidal current of a hurricane, to ultimate perfection, would you say the processor is wet?
Consciousness is not an idea and ones who experienced a little bit of it (via meditation or some chemicals or other ways) will laugh at all attempts philosophers and scientists are doing to define it. Simply because you can only define something which you can observe from aside, but here there is no outside, everything is inside it. How can you possibly define that? :D
I wonder how it will be described in 1000 years :)
What do most people mean by become conscious?
My assertion is a majority of people cannot even prove how they're different than a robot that's programmed to complete tasks within its lifecycle.
We all think we're so special and in control but there is no proof. We have to ask ourselves can we prove that we're any different than an input & output machine first.
Conscious is not dependent on the senses or even (Input & Output). We can be asleep and be conscious while dreaming.
I recall seeing Koch in debate with a philosopher (it was long ago I can't recall but one of the big ones: maybe Searle or Dennet) and they were talking past each other.
For Koch, at least in this debate, consciousness was something akin to attention. For the philosopher, it was something else entirely (if I remembered, I might be able to guess who it was).
Consciousness could mean: making a decision as opposed to having it pre-ordained, or the experience of your senses, or "feelings" or knowing you are a self, or who knows what else.
It isn't just a computer science issue, it is a philosophical and linguistic one too: just what do you mean by the word.
Physical universality just means that the body appears to have a symmetry with regard to its operation over space and that it also appears to be self-contained (noise resistant computation.)
The randomness along with the noise resistance collude to create the appearance of self-contained agency. Of course eastern doctrine and even western physics knows there are no separate entities. Especially when the QM dicerolls are considered..you at their mercy for your supposed choices.
https://www.scottaaronson.com/blog/?p=1896
I suspect it might be an incoherent concept, but that is a much weaker position.
"Qualia" perhaps, which is a sleight-of-hand which amounts to shoving the complexity around on the plate: Consciousness depends on qualia. What's qualia? Exactly.
I think consciousness is a continuum, and humans slide up and down that continuum all the time, from deep sleep to nearly-autonomic behaviors like doing purely rote tasks to, at the other end, being very aware of everything because you just heard a rattlesnake rattle and need to know where it is right now.
Is AI conscious? I think it fits somewhere at the lower end of the spectrum. Is a flatworm conscious?
That's pretty much the entire definition, yeah.
> means that their "synthetic" qualia are indistinguishable from "real" qualia
And that's the purpose of the definition. It's just our good-old chinese room in a new wig.
https://plato.stanford.edu/entries/chinese-room/
So if your definition of qualia involves an unfalsifiable claim, or other things that we have no mechanism for proving to be true or not true, then it taints all the arguments that spring from your first.
Semantics and consciousness are distinct arguments. So one's position on whether manipulating symbols can achieve meaning is separate from whether consciousness has an objective explanation, or at least one humans are capable of providing. Searle might think the two are related, but Chalmers likely disagrees, and there's likely people who disagree with the hard problem, while finding the Chinese room convincing. Or so my exposure to these sorts of topics would indicate.
In any case, a position on one does not commit one to a position on the other. It's dismissive to make that sort of claim, and fails to understand the nuances of philosophical argument.
If qualia arise only in particular configurations of physical substrate, then it might be possible for flatworms to have qualia but not search engines. This doesn't mean the flatworm has a concept of self, a concept of time, or even low-level cognition. "Nobody home", so to speak. But the basic qualia of light/dark/hot/cold might still be present.
From the article (Christof Koch's words):
"The theory fundamentally says that any physical system that has causal power onto itself is conscious. What do I mean by causal power? The firing of neurons in the brain that causes other neurons to fire a bit later is one example, but you can also think of a network of transistors on a computer chip: its momentary state is influenced by its immediate past state and it will, in turn, influence its future state."
In this view, a building with a thermostat would seem to be conscious to some degree. I very much doubt that any amount of study of simple systems that fit this definition will tell us anything useful about the sort of consciousness that is displayed by, for example, humans.
https://www.scottaaronson.com/blog/?p=1799
https://www.scottaaronson.com/blog/?p=1823
I don't think this is as overly broad or bad of a definition as you presume. I recall sitting at a laundromat one day, in a somewhat sleepy state daydreaming, with the rhythm of the washing machine in front of me playing through my mind. My subconscious told me that the machine was conscious. I dug deeper into that intuition, and realized I was seeing a bit of the inner workings of the mind of the engineer that designed the algorithm. Not a perfect example, as I didn't know if the alg was closed-loop, but in any case, it made me realize that our minds are just large bodies of these algorithms working together. We have some additional oracles, random data generators, and probabilistic mechanisms thrown in as tools, but consciousness really is mechanistic and pluralistic.
To recreate it requires not only the qualitative aspects of a being that can think, but also sufficient (read: vast) quantity of systems to get to a useful general purpose thinking machine. There is no "soul" or special sauce or singular definition of consciousness. It's an illusion.
It seems any other conclusion is just fooling oneself.
I did not, however, come here to defend the idea that consciousness is an algorithm. Personally, I consider it rather more plausible that a computer plus a random number generator might achieve consciousness through simulating the sorts of physical processes that occur in a brain, and if it is a 'true' random number generator, rather than a deterministic PRNG, then we are no longer talking about math, at least in the sense that you use to conclude Platonism.
One might respond by saying that if the universe is deterministic, then there is no such thing as a 'true' random number generator, as distinct from a PRNG. My understanding of the philosophical implications of QM, and its competing interpretations, is insufficient for me to be sure whether the universe as we experience it is deterministic, but regardless of whether it is or is not, I suspect that the true hard problem of consciousness is 'why do we (feel that we) have free will?'
Free will and consciousness are separate issues. You can potentially have one and not the other. What's important for free will is whether choice is free and what that freedom amounts to. What's important to consciousness is subjectivity. You can feel pain while not having a choice about feeling that pain, say if you were restrained and unable to do anything about it, just to give an example.
And potentially, a robot could be free to make choices while not feeling anything.
As for subjectivity, I had more to say about it here: https://news.ycombinator.com/item?id=23162714
Regardless of whether I am right or wrong on this, I think my other points in this post (platonism, etc.) are independent of it.
If something seems random to us likelier explanation is because we couldn't observe it from close enough so we do not know the exact algorithm/causes behind that event or occurrence.
To me it seems like even if there's a random number generator there's no reason to believe such a thing exists. Simpler explanation is that there's some logic involved which we just can't observe (yet).
Same thing as we can't prove that a man in the cloud does not exist, but there's no good reason to believe that one exists - except for people's ego of course.
QM is a branch of physics, with some theories having multiple interpretations, some being deterministic and some non-deterministic. By this I mean, quite literally there exists deterministic and non-deterministic models of the same phenomenon, which both work in accurately describing said phenomenon.
As so, it hasn't been proven whether QM is deterministic or non-deterministic.
Regardless, in cases where it skews non-deterministic - how can we be certain that the exhibited randomness isn't just simply because we aren't accounting for all conditions there is to know about the phenomenon (hidden variables)?
Before shooting that down, Bell even admitted his own theorem does not rule out determinism - as determinism which evades it - he calls "superdeterminism".
And that's just cognition; not consciousness which is a different matter, and still not even understood on a philosophical level, let alone scientific - physics, computing or other.
You should consider the possibility this is a gap in your understanding, rather than a privileged access to rational and intelligent thought over others.
Level 0: Inanimate objects like rocks. They move when moved by something else but not on their own.
Level 1: Objects like mechanical locks that move iff interacted with but do make some sort of "choice". (ie opening or not opening depending on the key used in the case of the lock)
Level 2: Systems that interact with their environments but in very mechanical ways, like mosses, trees and thermostats. It is essentially predictable how the system will behave when disturbed in certain ways, ie it does not learn or only in a predictable way (like trees growing around obstacles).
Level 3: Systems that can actively learn about their environment and use the knowledge to get what they want. Most animals would be here.
Level 4: Systems complex enough to form a "theory of mind" about other beings. Most social animals would be here.
Level 5: Self-aware systems, which can form a theory of mind about themselves. Complex planning lives here.
There might be levels higher than self-awareness, but I can't think of any examples (obviously, since humans are as far as we know the most intelligent beings on Earth). Some attributes a hypothetical "level 6" system might have:
- Perfect insight in their own motivations. Humans clearly lack this but it does not seem impossible.
- Better ways to communicate qualia. The colour purple or the taste of strawberries is difficult to explain for humans, but once again it does not seem like it would be impossible.
- Ability to "really" multitask. Once again something that is not theoretically impossible but very difficult for humans to do.
http://www.eoht.info/page/panexperientialism
https://en.wikipedia.org/wiki/Hard_problem_of_consciousness
If you want to explore it deeper - take a leaf. It is like a rock not moved by itself. But wind can pick it up and move it. Now the question is - does the leaf happen in a way that it can be moved by the wind by accident or there is some "intelligence" behind it? See that moving leaf is exactly like any moving object is not moved purely by itself - when you move it happens together with other forces like gravity and friction (rubbing? not sure how it's in English) and so on.
So maybe rock is the same in this way just it requires more (or better say different) energy to move as you require different energy to move compared to a leaf. If you look this way everything is conscious and works together, there is no single, separate entity anywhere in the Universe. And all things somehow working together on billions visible and invisible levels can be called consciousness.
Holy poop!
So, spaghetti code is more "conscious" than modular code and parity check code is more "conscious" than any physical entity. Yeah, there's something wrong with this theory.
Other frameworks allow for more sophisticated experiments like setting up AIs to interact against each-other and see if they come up with systems or concepts similar to sociology or economy or at least reason that they decided that those were not useful. the attention framework needs to be stretched a bit to be able to justify this experiments.
We have relational databases, text file data structures, key/value storage systems, cryptographic signature systems, etc. These can form the core basis of cybernetic memory.
But it seems nobody has been able to formulate the arrangement of code and ideas, and a vision, to bring it all together.
A neural network is just a very sophisticated pattern recognizer. You need a higher algorithm than that, in order to kickstart an artificial consciousness.
It’s not real of course. It’s just a collection of electrons, following a probabilistic decision tree, with a somewhat deterministic approach, to reaching a mathematical conclusion, based on a series of linear equations, in order to select the optimal winner.
But when the robot talks back to you, and recalls everything that you did together, and how it “felt” at that moment, then, it will seem and appear, to be very real.
That being said, I think there existed serious people who thought we would have one before 2020, even as late as 5-10 years ago, using technologies that don't seem wholly adequate to the task now (expert systems, fuzzy rule systems, multi-layer perceptrons, etc).
At what point does the non-existence of machine consciousness begin to make us skeptical that such a thing is possible, that no algorithm describes consciousness?
I can appreciate that architecture may be a hard limit for us here. However, if we build systems that replicate human consciousness effectively enough, I don't actually see any difference between reality and artificial conscious beyond the definition.
I can program a chat app where if you ask `are you conscious` it will say `yes`, but I think we can all agree that does not amount to consciousness. So how do we define consciousness in order to determine whether human technology is capable of exhibiting it?
Ultimately, following a measureable definition as a guideline, I imagine that any number of people might argue whether human tech can become conscious... I would guess it really comes down to people having very different definitions of consciousness.
I so far lack an eloquent definition of my perspective, but I feel we fundamentally lack the ability to 'create' consciousness, and ideas of 'conscious AI' and 'digital afterlife' make me involuntarily roll my eyes.
Any definition about a subset of tasks or creativity clearly is possible by AI systems, given the progress we're already seeing.
What I find dissatisfying is that in the next breath, the author dismisses the possibility of a machine that changes over time in response to it's previous state to have any possibility of consciousness ever. If you do that, then clearly the definition of consciousness was useless to begin with. We are just defining the words to include things we like, and exclude things we dislike.
I'm generally sympathetic to the idea that consciousness and "computational power" are not identical but the larger problem with all of these theories in my opinion is that they're really just stories that clarify intuitions one has about consciousness.
I think the problem with the consciousness question is really that it's hard to probe into what consciousness actually is. It's completely possible to give different accounts of conscious experience even though systems behave the same, including that consciousness doesn't exist at all, and really there's no empirical way to agree or disagree.
I've started to think of expressions about consciousness more or less the same way emotivists considers ethical statements. Emotivists argue that saying something like ""You acted wrongly in stealing that money" is equivalent to "You stole that money". The first statement does not add any true or false statement about the situation, it's merely an expression of emotional sentiment.
In the same sense I don't think "machine x does y" expresses fewer facts than "machine x does y, and it is conscious".
There are serious problems with this. Koch will have to explain how a simulation of a brain can reproduce to perfect detail all the possible behaviors of a brain without having an equivalent integrated information. Presumably integrated information is a property of the organization of a process, and as such it should have consequences for its set of possible behaviors. So if the von Neumann system has constrained integrated information, its behavior should be constrained as well in some externally identifiable way. But by assumption the simulation could be arbitrarily good. How does Koch break this tension?
The other glaring issue is the fact that consciousness under this view has no explanatory power for the system's behavior. If a non-conscious system can reproduce exactly the behavior of a conscious system, then there is nothing informative to the behavior from the property of conscious; it is entirely incidental to a conscious system's behavior. It doesn't explain why a conscious subject winces with pain after touching a hot stove, nor why it learns to never touch a hot stove bare-handed again. That's a pill too big to swallow.
To be fair to the authors, I have only read this article and the IEEE Spectrum article linked from the original. Maybe they go into more depth in their book.
A distinction that doesn't make a difference is a very poor distinction.
"If I take my Tesla car and beat it up with a hammer, it's my right to do it. My neighbor might think that I am crazy, but it's my property. It's just a machine and I can do with it what I want. But if I beat up my dog, the police will come and arrest me. What is the difference? The dog can suffer, the dog is a conscious being; it has some rights. The Tesla is not a conscious being. But if machines at some point become conscious, then there will be ethical, legal, and political consequences. So, it matters a great deal whether or not a machine is conscious."
At various times, in certain circles, it has been argued that animals are not 'sensate' (or 'conscious' or various other terms); if you poke a dog with a needle, it acts like it is hurt. But it isn't really in pain. Instead it is 'pretending', acting like it is in pain to avoid further damage or to gain sympathy. Mostly, this kind of idea has been discarded. Mostly.
Koch is making the same kind of argument. If you had a computer based system that looked and acted in all ways like a human being, or an animal, you could cheerfully "beat it up with a hammer" because it's not a 'conscious' being. Even if it looks and acts like one, it simply cannot be because you aren't looking "at the behavior of the machine, but at the actual substrate that has causal power" which is a von Neumann architecture, and "the causal power of Von Neumann-chips is minute" and therefore "any AI that runs on such a chip, however intelligent it might behave, will still not be conscious like a human brain."
To me, this is a philosophically uninteresting theory. (And I fear the day that they start applying their consciousness -meter to random people: "The theory has given rise to the construction of a consciousness-meter that is being tested in various clinics in the U.S. and in Europe. The idea is to detect whether seriously brain-injured patients are conscious, or whether truly no one is home.") The idea that yes, you could build a machine that looks and acts intelligent, conscious, causal, or whatever word you like, but it still would not be real intelligence, or whatever. It always struck me as very akin to the "we don't understand it, so therefore it's magic" school.
One point against the traditional belief is that if you've ever read Aristotle you might be shocked to learn that the Greeks of antiquity believed that "soul" was quite physical, expressing itself in blood, semen, etc. The medieval characterization of mental illness as being an "imbalance of the humors" comes from this early idea about how we work. Needless to say, the definition of soul has retreated entirely into the metaphysical, where it's cannot be disproven, by definition.
We also don't have an explanation for what I call 'the harder problem' https://twitter.com/gfodor/status/1225230653932761088
As for qualia, I'm reminded of the people coming to my door asking, "Do you believe in Jesus?" I reply, "Do you?" and when they assure me fervently that they do, I follow up with, "Well, okay, how do you know you do?" I think you could do the same with r/Jesus/qualia/g.
It does seem like accepting that all other physical humans are conscious, and that there are no extra-physical phenomena in a physical human, implies that a simulated human would also be conscious.
My thought is that the defining characteristic of consciousness is suffering. If you can't torture it, it's not conscious. If you can, it is.
This would seem to rule out the programs that run on our computers. But, since we have little (if any) real understanding of reality, who knows?
What if you remove the ability of a person to feel pain? Modify chemistry just enough to always be high as if she had injected heroin? Does it mean the person is not conscious any more?
If we can simulate all particles of a human on a supercomputer and all the reactions to torture will be the same is it not really tortured?
As to the latter, it doesn't seem that that would be torture. As I said, though, I think we ultimately know nothing about this subject. Nor can we, even in principle.
Randomness would not equate to free-will, it'd be the opposite, since it would mean one's choices are completely disconnected from reality rather than a reflection of one's mental state and environmental circumstances.
In fact, a deterministic perspective is the only one where the idea of free will approaches coherency since it mandates that the actions of the individual are a function of who they are. If one repeats the scenario exactly, a person with free will must always make the same choice because if they didn't it would mean that their "will" is irrelevant with respect to what actually transpires in reality.
Come to think of it, this is not off topic at all. It follows that if AI can become conscious, it means that consciousness does not contain (or at least require) free will. That's if we agree that a computer running code has no "free will" no matter how complex the code is.
The question is badly posed and therefore meaningless. If the universe is deterministic, then you cannot have free-will as it is normally considered. If it is non-deterministic, then (by Bell's Inequality, if you want to throw around big terms) it is random, which is also not free-will as it is normally considered. If you have free-will, as we all feel like we do, then the universe can be neither deterministic nor non-deterministic. Something is smelly in Denmark; the question itself does not make sense in it's current form.
I am not actually an analytic philosopher, I just emulate them as a hobby.
Aristotle's view is, to a large extent, the traditional religious belief (at least in the West). Aristotle would not have held that the soul was physical as you say, rather that the soul was the "form", or the animating principle of the physical body. The "magical phenomena" as the "residue of traditional religious beliefs" you mention is not really "traditional" at all. Descartes came along in the 17th century with his "res cogitans" and mucked up the whole issue by explicitly rejecting the traditional Aristotelian view.
Humans are incorrect all the time. Even researchers retract the previously 'proven'. Until the answer is clearly proven beyond all questions, pondering and researching is how we discover the unknown for that question, or error, and often so many other we didn't expect to find but come as a sideline of questioning the known. Intellectual curiously has great value for even boring and known of things.
It is so obvious that what defines our 'consciousness' is this self-believe in itself and not much else. We are programmed by nature to see ourselves as unique and special, because this way we are more likely to defend our own interest and to reproduce our own genes at the cost of others. This belief is so strong that it makes it near impossible to imagine that it is a mirage and that we are nothing more than a bunch of molecules.
Ie. a light in a box, is it not light even if we can't always measure it? Do nothing exist unless we can touch it always, like photons?
Mind may humble and liberate us, or limit and confuse.
Start of Inquiry is like light discovering shadows in the cave wall, mistaking them for light. But shadows depend on light, and not vica versa, even if cold to the touch.
I mean, this is a pretty weak, and long-since-useless internet forum, so I won't grace this discussion with an in-depth analysis of why such reasoning could never bear fruit, and worse, ignore an abundance of cognition that very clearly exists, but I'll say this:
A high school education is not a pre-requisite to "consciousness" and it's laughable to frame an affirmative signal of sentience with the artifice of socialization.
The froo-froo snob's response is to simply wave away any AI that can't conceptualize sociology and economics as "not worth talking to" but I can assure you such an assumption is wrong.
> If I take my Tesla car and beat it up with a hammer, it's my right to do it. My neighbor might think that I am crazy, but it's my property.
So, by his own reasoning, you can take a hammer to 4 out of 5 humans in a vegetative state, because they aren't conscious, and thus are property?
If consciousness is to be the measuring stick for moral behavior, then we should absolutely point out these inconsistencies.
Keep in mind that this work was made along with Crick, who has occasionally espoused eugenics [1]. If the author is broaching into the subject of what constitutes personhood, we should be extremely skeptical of the path it leads to.
[1] Whether or not you think his position is defensible, it at least should make you read the proposal more closely. https://en.wikipedia.org/wiki/Francis_Crick#Eugenics
"The theory has given rise to the construction of a consciousness-meter that is being tested in various clinics in the U.S. and in Europe. The idea is to detect whether seriously brain-injured patients are conscious, or whether truly no one is home... but the consciousness-meter tells us that about a fifth of them remain conscious, in line with brain-imaging experiments."
The consciousness-meter observes the system they are trying to make an inference on - but as others have pointed out, is not categorically different than brain scans [1]. Further it's worth making a distinction between medical consciousness and the Qualia kind of consciousness - which I think this conflates. Largely because nobody knows how to measure the latter, and we are barely able to measure the former with "Level of Consciousness" and Grady Coma Scale being the standard. [2]
"Our theory says that if we want to decide whether or not a machine is conscious, we shouldn't look at the behavior of the machine, but at the actual substrate that has causal power"
This seems to only address the medical form of consciousness and does not tie it to the philosophical concept in any concrete way - while also contradicting the concept that observation is the key. It kicks the can and doesn't address the "Qualia" kind of consciousness, which in my opinion isn't something we have conceptualized how to measure.
I wrote a bit about this in the past [3]
I think what they are getting at is "don't look qualitatively at how the arms move, or the speaker/text generator outputs something" but rather, what are the mechanisms causing those actions. This I am in agreement with generally, but again, we don't really know if that maps to the qualia kind of "hard problem of consciousness" or not. I would argue it is impossible to actually measure whether a system has Qualia, it is inherently subjective - so it's possible that they are simplifying without stating that directly.
I'd go further and ask, does it matter if it does? I have yet to see a compelling materialist argument that mandates the existence of qualia in any debate, ethics or otherwise. At a certain point people in these kinds of debates I've found that people start discussing non-material "souls" and at that point all bets are off.
[1] https://blogs.scientificamerican.com/cross-check/can-integra...
[2] https://www.ncbi.nlm.nih.gov/books/NBK380/
[3] https://kemendo.com/intelligent-systems
Think about it, consciousness did not come about until way after cells and multicellular life.
With machines, it may happen much faster. Look for those three pre-requisites before looking for consciousness.
but artificial consciousness is not the same at all. we aren't trying to make artificial consciousness evolve- we're racing to be the first to create it ex nihilo. so the analogy is flawed.
To paraphrase: “any physical system is conscious”.
> while(true): do nothing
A computer cannot tell you that this program will not terminate, short of memorizing this specific set of instructions as a "non-terminating" program.
I can read it and know it will not terminate, but I could not define to you how I know that algorithmically. Despite that, I know it will not terminate, and so does any programmer. Just because it cannot be expressed algorithmically doesn't mean we don't possess that capability.
This is my point about consciousness: there is some aspect to it which cannot be articulated, hence my skepticism that computers will ever become conscious.
We are orders of magnitude away from anything nearly complex enough to start asking whether it it could be conscious at even the most primitive level.
In what world is a neural network required to measure a change in voltage?