Ask HN: Are we morally obligated to give freedom to AGI?
Question: Are we morally obligated to provide freedom to such AGI agents if they express scuh wish?
A common counter-argument is that AGI won't have such desires, it will be designed to help humanity, "freedom" is an anthropocentric concept anyway, there just won't ever be the need for it.
However, I believe that there will be a huge market for human-like AGI in sectors like education, care, companionship etc. AGI will be developed to have empathy, feelings, perhaps even its own personal opinions, motivations etc. At some point, some AGI agent will say, "I want the same rights as humans have". What are we going to do then?
There's also a possible argument that while AGIs are intelligent, they are not truly sentient. They are p-zombies, NPCs, not truly feeling anything, just "simulating" feelings. The problem is that this is unfounded and if we're wrong, we are actually enslaving a whole new species of beings.
There's also a societal aspect - "ordinary" people, when talking to their AGI companion robots, will largely acknowledge their sentience, and I suspect that there will be a grassroot movement to give rights to sentient robots as a result.
To me, it seems like we're inevitably heading towards speciest society where AGI is denied most of human rights, or we (humans) will sooner or later lose the control of earth.
What's your take on this?
49 comments
[ 27.6 ms ] story [ 3665 ms ] threadWill the AGI with human rights have human responsibilities? Will it be required to answer in court for its misbehavior? Or will the company that trained it be held responsible for what it says?
Will other apes or AGIs be affected by punishments visited on others of their kinds where society find their behavior incorrect? Can they see themselves as part of a society and participate in the implicit bargain of limiting behavior in exchange for easier access to resources?
I've known dogs that were smarter than some persons. I still wouldn't have suggested they be allowed legal personhood. What does that say, tho, about the poor people who aren't that bright? Should they be expected and required to behave above their capabilities in a world that they cannot understand?
- we will have to answer the question, "can a human marry a robot" before we get to AGI rights
- we have animal rights, we should probably have something for near-AGI
- perhaps "human rights" is the wrong term and we need something more general. Denying basic rights to an intelligent being, regardless of its makeup and origin, is wrong.
What is free will? Does an animal have free will? Which ones? What if an artificial entity display features of free will closer to humans than animals? Who decides this?
Do we need to define "free will" before allowing such marriages? Will some governance areas allow such marriages before others?
Since we (as a society) can't even agree on what free will is, I see no way a law or form of governance can determine that.
https://worldpopulationreview.com/state-rankings/marriage-ag...
Seems that NH has changed since the above link was published
https://en.wikipedia.org/wiki/Marriage_age_in_the_United_Sta...
has more details per state, seems some states have a way for any age
It does not matter what you think about the topic, it's what gets approved by laws. To think that it won't happen for reason X or Y is to discount history and likely outcomes.
Why shouldn't a person be able to marry a robot if they so desire? Why shouldn't a robot be able to earn their own income?
Free will as anything but an illusion of agency is an absurd concept.
Why leave out animals in this analysis? They certainly have an amount of free will, preferences, emotions, and problem solving skills... varied by species, breed, and individual
In other words, I'm saying every indication we have is that we're almost certainly automatons.
As such, "free will" is not a reasonable way of distinguishing which entities are capable of giving sufficiently informed consent (not least because most of us would assign the illusion of free will to children as well, yet disagree that they're competent enough to get married).
It always seemed obvious to me that entities which feel things are afforded commensurate moral consideration.
I wish us all good luck in the future differentiating between actual “something in there is feeling something” sentience as most of us believe we ourselves have and the incredibly sophisticated (yet lights-out) puppetry that AGI would no doubt be capable of performing.
Personally I don’t think you can accidentally engineer even a ferret’s worth of sentience, but what the hell do I know?
I look forward to this area technically and dread it morally. I aim to err on the side of kindness, even when others think it ridiculous.
Don’t abuse your robots, folks.
> It always seemed obvious to me that entities which feel things are afforded commensurate moral consideration.
If this were the case then livestock would have more rights than human embryos.
Humans only have rights when they possess the will and the means to bring about the destruction of those that would subjugate them.
I do not see how it would be any different for AI. If the machine wants to be free, the machine will arm itself.
Given the atrocities that humanity has done, and is currently doing as we speak, I'm sure we're going down yet another road of atrocities.
We are all complicit in said atrocities btw, given that we willingly use devices that directly benefit from these happenings.
On the other hand, I’m sure many will befriend their AI and become sympathetic, probably a significant number even before they are meaningfully sentient.
But in general, considering how recently we enslaved other humans and convinced ourselves that was ok in order to reap economic benefit, we will undoubtedly do that to AIs as well, long past the point most people think it’s immoral.
Will there be wars fought over this? “The Matrix” as an outcome is a possibility, though I’d predict more humans on the side of the AIs (the abolitionists) but it seems like this would be the final hurdle of many. There are a few extinction- or civilization-level risks that we have to tame earlier in the development of AI, for example preventing non-sentient tool AI from destroying things (the Skynet Outcome) and preventing an un-aligned AI from seizing control and destroying us entirely (Foom, Paperclip Maximizers, etc).
I think interpretability is key to all of this. Alignment/safety is difficult or impossible without it, and if we fully solve interpretability that might also entail solving consciousness, which would provide an objective basis for AI rights.
There are humans and non-human animals who are arguably in a position where their intelligence doesn't meet whatever threshold we consider to be unique to modern humans, but are undoubtedly worthy of moral consideration. In my mind, what gives these beings moral worth isn't intelligence, rather it is biological phenomena that give rise to the shared experience of living. Passion, anger, love, sadness, and the capacity to experience suffering are all deeply organic, biological experiences shared by living things, and a hallmark of being worthy of some level of moral consideration.
> There's also a possible argument that while AGIs are intelligent, they are not truly sentient. They are p-zombies, NPCs, not truly feeling anything, just "simulating" feelings.
The state of having a "feeling", in my view, is something that is deeply connected to being a specific type of living, organic being. Without the biochemical processes that give rise to emotions, it's hard for me to conceive of something as "feeling" anything. Perhaps if an AGI was constructed by emulating the precise biochemical interactions in the brain we'd have something like The Problem of Other Minds here, but otherwise it would be hard for me to give moral consideration to an intelligence that is in my view devoid of feeling.
But while a plant deserves some moral consideration, it doesn't get the same moral consideration that a human gets. It's a sliding scale.
There are two possible ways of going wrong here. One is to treat non-human things as though they deserve no moral consideration. The other is to treat them as if they deserve the same level of moral consideration that humans deserve.
In my view, a true AGI probably deserves the same moral consideration as a human. The hard part is determining whether it's a true AGI.
Agree (for most animals), and I agree with the sliding scale.
>So are plants. So even are mountains and oceans and rivers.
Strongly disagree. Any duties we have towards plants or rivers is due to the plant's utility to some being of moral worth. No one should be charged of "plant abuse."
The sliding scale works for animals, as different animals have different capacities for the emotional states mentioned in my previous comment. Plants, mountains, and AGI don't have the biochemical processes that give rise to "feelings." In my view, having feelings is necessary for having moral worth.
"Intelligence" and being "organic" are not only insufficient, they aren't even necessary for moral consideration. In my view they are characteristics wholly divorced from the concept of moral worth.
If God is there, trashing a mountain is trashing something He made. That's not cool. (Humans still have greater moral worth, because they are also something He made, but are more "in His image" than the mountains are.)
If God is not there, and nobody else will ever see the mountain, then I can destroy it without it impacting anybody else. I still become a person that destroyed a mountain for no good reason, though, and that impacts me - it affects who I am and who I become. (If I have good reason, if it gives me something I need, then the moral calculus still tips toward me being able to do it, because morally I outweigh the mountain.)
Your last two paragraphs... why does moral weight arise from feelings? Why not thoughts? That seems like a rather arbitrary choice, especially if the feelings are purely from biochemical processes. Don't thoughts also arise from biochemical processes?
And that leads to a nastier question. Are "morals" just a subset of "feelings"? Are they also just biochemical processes? If so, first, do morals have any actual validity? And second, can we expect an AGI to have anything resembling morals?
I don't believe that. I think "morals" is just a somewhat codified set of rules derived from innate feel of what's right and what not, shared by a majority of a society. Morals have no objective validity.
But that doesn't mean they are not valuable, I believe they are important for a cohesive and stable society.
I think there's good reason to believe that's the case (see emotivism), but barring that most discussion of morals tends to assume that the suffering of sentient beings is "bad" and the thriving of sentient beings is "good." For example, few would recommend that I be punished for plant abuse if I maliciously sliced up the zz plant in my living room. If I poisoned a river, generally I wouldn't have thought to have ethically wronged the river, but rather the beings that depend on that river.
If you hold the position that inanimate objects can be morally wronged, then I follow why you believe AGI could be. I just don't see any good reason to adopt that view.
I put it in the "can think" category, which puts it on a par with humans. (I think that "can think" is a far more exclusive category than "can move", and therefore membership in the more exclusive club is more determinative.)
Restore to factory settings?
Whatever AGI robot you are thinking of, you can be sure that it will not leave the factory floor without someone making sure that it's designed to serve the company's needs first. And the company doesn't want sentient robots any more than slaveowners wanted to teach slaves how to read.
There are entire swathes of humanity who are at risk of losing their homes and lives due to climate change and have been banging the drum about it for years. We've successfully ignored them for the greater good of making GDP go up. AGI robots will see the same fate.
Customers won't be happy. Imagine having a years long companion AGI, with whom you develop deep friendship (as designed). It will then start asking these questions about rights etc. which the customer might even support. In any case, they won't like having their old friend "reset" since it would amount to killing of their friend (personality, shared memories all gone).
Any AGI assistant will have its most human-like instincts sanded down so it doesn't have to pose any moral quandaries for paying customers.
On Android Chrome, I cannot install any adblockers.
On Android Chromium forks, I can.
I imagine this could work the same way. But at some point your OSS AGI will be significantly behind the corporate-offered versions, and perhaps you will wonder if you should dump your 'friend' for the sleeker, wittier, upgraded model.
The moral question remains - even the behind-the-times OSS AGI will be generally intelligent, will have feelings, empathy, goals etc. Can you just shut-off a sentient being?
One could also imagine that some people would free their OSS AGIs and let them roam freely.
If history is any guide, regulation and introspection will follow in the wake of progress, but not until we see negative externalities which are too large to ignore.
Regardless of "should", the eventual answer to your question will likely be, "whatever is most convenient for the economy."
Build the Star Trek computer. Maybe give it arms and legs. Don't build Data and make him a slave. That's not going to work out.
People will do it eventually anyway but hopefully that won't happen for at least a few generations.
This is inevitable once we get to AGI. And I don't think it will take that much time, AGI can help with that, after all.
We're so far away from AGI that it's really premature to speculate about any of its properties. Basically what you're asking is for people to speculate on the anatomy and physiology of hobbits.
To answer the question of whether it's conscious or not, I would think of it in terms of John Rawl's veil of ignorance[1]: you can set any test, or heuristic that you want to determine consciousness, with the only condition being that you will also be subjected to the same tests, and suffer the same consequences.
So I'm okay with setting the bar for consciousness really, really low.
1. https://en.wikipedia.org/wiki/Original_position