> As Pope Francis warned, we must realistically ask ourselves who holds this power today and how they use it: “It must also be recognized that nuclear energy, biotechnology, information technology, knowledge of our own DNA, and many other abilities which we have acquired… have given those with the knowledge, and especially the economic resources to use them, an impressive dominance over the whole of humanity and the entire world.” [7] In the past, it was largely up to the State to guide and direct innovation. Today, however, the main drivers of development are private, often transnational, parties that are endowed with resources and the capacity to intervene that surpass those of many Governments. Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.
I look forward to reading this in detail. As I get older (and perhaps as AI has allowed me to spend more time thinking and less time doing) I've found myself thinking more and more about what it means to live a virtuous life and about ethics and morality and so forth. I don't have any answers (and I'm not looking for them, really, just musing) but I do find it very interesting to read and learn from and about those whose job it is to think about the answer to those questions.
There are a frightening number of people in the world who simply don't care about what happens to people they don't know or they simply think they're going to be at the top of the food chain one day so they think they will benefit from the current system. This is captured in the quote where most Americans see themselves as "temporarily embarrassed millionaires", attributed (possibly falsely) to Steinbeck.
It's been interesting watching the various approvals for AI data centers and, as far as I know, zero communities have wanted them. I'll be happily proven wrong on this. It is at least the vast majority. Yet their elected representatives simply do not care. Sometimes there are votes in the dark of night, sometimes the police are used violently against any dissent, sometimes anyone protesting these are called violent (even terrorists) and so on.
It goes so beyond unpopularity though. The tax breaks given will be paid by everybody else, as will the extra electrical infrastructure, while the data centers get preferential electricity rates.
What's really depressing is that not only do the representatives not care, there is obviously no fear of repercussions. Will they get voted out of office? Probably not. But even if they do, i guarantee you they'll find themselves in some nameless six-figure job in the industry for their service afterwards. Their children will get these same "jobs". It is so nakedly corrupt and nobody cares.
This simply can't continue while everything becomes increasingly unaffordable, ironically much of that driven by AI (eg RealPage driving up rent prices or the meat-packing collusion driving up beef prices). I firmly believe we're rapidly bouldering towards complete societal breakdown.
All this while we'll likely mint our first trillionaire in our lifetimes. And that means a literal billionaire will be closer to being homeless than being the richest person on Earth.
It's particularly funny to me that the US administration has gotten into beef with the Pope for being too "woke". Honestly, I had my doubts when a Chicago man became Pope but he seems to be a rare voice for compassion in this world thus far.
We honestly need to look no further than the Global South to see how this will play out. Many in the West just don't realize how horrific and predatory colonialism is and that's not a historic artifact. It continues to this day.
"I have to sin because those non-Christians might sin" is an interesting chain of thought.
Religion is about many things, and a major theme is depriving yourself to demonstrate your faith. Refrain from sin, pray for forgiveness and repent your mistakes. Live as a good example, give aid and charity to others. These are all commands in the Bible.
Concern yourself with your own sins, not those of others. Do all this and you will be rewarded in heaven.
Wonder what Jesus would have to say about your thoughts here - that you have to break the commandments of your God because if you don't, someone following a different god might break them first. It doesn't sound very Christ-like to me.
> what it means to live a virtuous life and about ethics and morality and so forth
> I don't have any answers (and I'm not looking for them, really, just musing)
I'm not sure why, but even in my general pessimism it hadn't occured to me that there are people out there who are uninterested in what living a virtuous life means. I truly just assumed that just about everyone had some sort of convoluted self-justification. That you say you don't even try, and want to read about it from "those whose job it is to think about", blows my mind. Do you think of yourself as an ameoba without free will or something?
Divided into five chapters, Magnifica humanitas has an underlying premise: technology is not “a force antagonistic to humanity” (4), nor is it “inherently evil” (9). However, “technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it.
Therefore, Pope Leo XIV appeals for people to build “for the common good” and to “remain human,” following a courageous mentality of shared responsibility and communion, so that the world “will come to recognize the human heart as the place where God desires to dwell” (16).
AI must be “disarmed” in order to free it from the mentality of military, economic, and cognitive competition. “To disarm means discrediting the assumption that technical power automatically confers the right to govern,” he says. “To disarm does not mean rejecting technology, but preventing it from dominating humanity” (110). He devotes ample space to a critique of transhumanism and posthumanism, which interpret progress as the overcoming of human limits. Instead, limitations are not defects to be eliminated, but a constitutive dimension of the human person, because it is in fragility and finitude that relationship and openness to God and to others mature. He says we must remember that “humanity flourishes not despite limitations, but often through them” (118).
Pursuing technological innovation at the expense of eliminating human limitations, he says, would cause an anthropological regression. “Humanity—in all its grandeur and woundedness—must never be replaced or surpassed,” he says. Technology can alleviate humanity’s sufferings and open new possibilities, but it must not deny the essence of humanity, which is our “capacity for relationship and love” (126). In the face of AI, says the Pope, “the true alternative is not between enthusiasm and fear, but between two paths of development: a progress that serves individuals and peoples, or a progress that subjects them to the mentality of power” (129).
That's a long read. I grew up Catholic, went through a pretty devout few years in my early adulthood, but ultimately I have decided that it is not for me. I send my kids to a Catholic school though (it is deeply tied to our culture), so I guess in that sense it is still worth my time reading it in full.
EDIT: Few paragraphs in, it is beautifully written.
> a uniformity that eliminated diversity and that chose homogenization over communion
Unrelated to AI, but a wonderful support of the breadth of humanity in this anti-DEI time.
> We must, then, avoid the “Babel syndrome,” namely the idolatry of profit that sacrifices the weak, a uniformity that neutralizes differences, and the pretense that a single language — even a digital one — can translate everything, including the mystery of the person, into data and performance.
There is a lot to read here. I am curious where the meditations on the 'mystery of the person' will go: a brief search doesn't show further mention. The encyclical appears to focus on exhortations for us, humans, than on the nature of AI. Probably wise at this stage. I feel it is not AI that is either positive or negative, but its use of it, and the call-out to the growth of private industry as more powerful among nation-states is a strong statement for a institute like the Vatican to make:
> Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.
"Mystery" is a theological concept that is translated from the Greek word "mustérion." [1] Mysterious, mystical, secret, divine, not fully revealed. This sort of ineffable, irreducible truth you can touch but cannot fully grasp.
The reaction of astronauts to seeing Earth from space -- the mystery of creation. Parents seeing pieces of themselves echoed in their children who are nonetheless distinct and surprising -- the mystery of the person.
Much of the meditations in the encyclical are related to human dignity and fraternity. An example:
> Finitude, when truly accepted, does not diminish us but opens us to recognizing the face of God and others. Indeed, precisely because we experience limits — vulnerability, suffering and failure — we can recognize the inviolable dignity of every person, both our own and that of others.
I have only skimmed it, will definitely read carefully as soon as I have time. I will say, as an atheist, that regarding technology the Vatican has some of the best takes of any institution/government I have ever seen.
The Vatican as a religious institution has the best takes on most things. I only really disagree with them on their view on abortion and frankly I can see where they are coming from on that one. It’s just that I think that not allowing abortion leads to having a lot of unwanted kids that suffer a lot through their lives.
I frankly disagree, how do you know "will this make humanity better?" until the product is done? AI wasn't what it is today because of a specific companies innovations. It stemmed from decades of research built on top of other research. How did any of those builders know what they were getting into?
Every technology should be done to the fullest potential, how are we ever supposed to explore the stars or cure cancer if everyone is scared of accidentally building Skynet?
Cue Pieter Thiel explaining how this message of compassion is actually the word of the ant-christ while setting his software (maybe "built in Rust !) to all the earthly empires.
for me the most important point in this is about how ai and tech in general concentrates power. if we want to build something good (in a moral sense) we need to put in work and make sure as many people as possible can use it with equal access.
this basically implies only open source models can be ethical but open source is not sufficient, you also need to make them give true information and avoid all kinds of harmful behavior. thats kind of a problem because if your weights are public even with a strict license a "bad" user can always fine tune it to remove any guardrails.
i think the solution for this is make sure the default behavior is aligned but let users turn on wild mode with zero censorship/refusals. that way everything is opt in, for example a parent can disable the mode for their children but a hacktivist or diy chemist can unlock everything.
as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.
Excited to read this. I really liked the note "Antiqua et Nova" from last year (still under Pope Francis). The autors showed a deep understanding of AI that many secular commentators lack. They developed the concept of integrated intelligence as opposed to the functional, reductivist view of intelligence that is prevalent in the AI community.
Why downvote this? The Holy See has an opinion on Artificial Intelligence? This is a fascinating document, and everybody should read it, and form their own opinions. The world currently seems to lack moral leadership, and who better to lead the cause of humanity than the Catholic Church?
As an atheist I have an obligation to finish reading it all (still going through, and taking notes, probably having to revisit), but I am not sure how many (christian) believers will feel the same.
@dang Is this item getting a lot of negative votes? I've no way of knowing, other than seeing my kharma increasing only slightly after all the points the story collected.
163 comments
[ 3.3 ms ] story [ 80.6 ms ] threadI look forward to reading this in detail. As I get older (and perhaps as AI has allowed me to spend more time thinking and less time doing) I've found myself thinking more and more about what it means to live a virtuous life and about ethics and morality and so forth. I don't have any answers (and I'm not looking for them, really, just musing) but I do find it very interesting to read and learn from and about those whose job it is to think about the answer to those questions.
This was an almost sickening sentence to read on so many levels.
It's been interesting watching the various approvals for AI data centers and, as far as I know, zero communities have wanted them. I'll be happily proven wrong on this. It is at least the vast majority. Yet their elected representatives simply do not care. Sometimes there are votes in the dark of night, sometimes the police are used violently against any dissent, sometimes anyone protesting these are called violent (even terrorists) and so on.
It goes so beyond unpopularity though. The tax breaks given will be paid by everybody else, as will the extra electrical infrastructure, while the data centers get preferential electricity rates.
What's really depressing is that not only do the representatives not care, there is obviously no fear of repercussions. Will they get voted out of office? Probably not. But even if they do, i guarantee you they'll find themselves in some nameless six-figure job in the industry for their service afterwards. Their children will get these same "jobs". It is so nakedly corrupt and nobody cares.
This simply can't continue while everything becomes increasingly unaffordable, ironically much of that driven by AI (eg RealPage driving up rent prices or the meat-packing collusion driving up beef prices). I firmly believe we're rapidly bouldering towards complete societal breakdown.
All this while we'll likely mint our first trillionaire in our lifetimes. And that means a literal billionaire will be closer to being homeless than being the richest person on Earth.
It's particularly funny to me that the US administration has gotten into beef with the Pope for being too "woke". Honestly, I had my doubts when a Chicago man became Pope but he seems to be a rare voice for compassion in this world thus far.
We honestly need to look no further than the Global South to see how this will play out. Many in the West just don't realize how horrific and predatory colonialism is and that's not a historic artifact. It continues to this day.
So even if we restrict the power of AI, others may not. And this might turn out to be a mistake.
I just hope this is taken into account.
Religion is about many things, and a major theme is depriving yourself to demonstrate your faith. Refrain from sin, pray for forgiveness and repent your mistakes. Live as a good example, give aid and charity to others. These are all commands in the Bible.
Concern yourself with your own sins, not those of others. Do all this and you will be rewarded in heaven.
Wonder what Jesus would have to say about your thoughts here - that you have to break the commandments of your God because if you don't, someone following a different god might break them first. It doesn't sound very Christ-like to me.
> I don't have any answers (and I'm not looking for them, really, just musing)
I'm not sure why, but even in my general pessimism it hadn't occured to me that there are people out there who are uninterested in what living a virtuous life means. I truly just assumed that just about everyone had some sort of convoluted self-justification. That you say you don't even try, and want to read about it from "those whose job it is to think about", blows my mind. Do you think of yourself as an ameoba without free will or something?
Therefore, Pope Leo XIV appeals for people to build “for the common good” and to “remain human,” following a courageous mentality of shared responsibility and communion, so that the world “will come to recognize the human heart as the place where God desires to dwell” (16).
Pursuing technological innovation at the expense of eliminating human limitations, he says, would cause an anthropological regression. “Humanity—in all its grandeur and woundedness—must never be replaced or surpassed,” he says. Technology can alleviate humanity’s sufferings and open new possibilities, but it must not deny the essence of humanity, which is our “capacity for relationship and love” (126). In the face of AI, says the Pope, “the true alternative is not between enthusiasm and fear, but between two paths of development: a progress that serves individuals and peoples, or a progress that subjects them to the mentality of power” (129).
EDIT: Few paragraphs in, it is beautifully written.
Unrelated to AI, but a wonderful support of the breadth of humanity in this anti-DEI time.
> We must, then, avoid the “Babel syndrome,” namely the idolatry of profit that sacrifices the weak, a uniformity that neutralizes differences, and the pretense that a single language — even a digital one — can translate everything, including the mystery of the person, into data and performance.
There is a lot to read here. I am curious where the meditations on the 'mystery of the person' will go: a brief search doesn't show further mention. The encyclical appears to focus on exhortations for us, humans, than on the nature of AI. Probably wise at this stage. I feel it is not AI that is either positive or negative, but its use of it, and the call-out to the growth of private industry as more powerful among nation-states is a strong statement for a institute like the Vatican to make:
> Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.
The reaction of astronauts to seeing Earth from space -- the mystery of creation. Parents seeing pieces of themselves echoed in their children who are nonetheless distinct and surprising -- the mystery of the person.
Much of the meditations in the encyclical are related to human dignity and fraternity. An example:
> Finitude, when truly accepted, does not diminish us but opens us to recognizing the face of God and others. Indeed, precisely because we experience limits — vulnerability, suffering and failure — we can recognize the inviolable dignity of every person, both our own and that of others.
[1] https://biblehub.com/greek/3466.htm
"Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it."
Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity."
The questions shouldn't just be 'can we build it?' or 'will people want this?'
We need to also ask 'should we build it?' and 'will this make humanity better?'
The encyclical calls on us to “join forces in building up the common good.”
This is a message we need right now.
Every technology should be done to the fullest potential, how are we ever supposed to explore the stars or cure cancer if everyone is scared of accidentally building Skynet?
this basically implies only open source models can be ethical but open source is not sufficient, you also need to make them give true information and avoid all kinds of harmful behavior. thats kind of a problem because if your weights are public even with a strict license a "bad" user can always fine tune it to remove any guardrails.
i think the solution for this is make sure the default behavior is aligned but let users turn on wild mode with zero censorship/refusals. that way everything is opt in, for example a parent can disable the mode for their children but a hacktivist or diy chemist can unlock everything.
as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.
Reading is a trained skill. Requiring years, even decades, of training. It too shall fall to AI.
https://github.com/n2ctech/magnifica-humanitas-epub/releases...
Quick browse through pre-AI works from John Paul II show em-dashes present.
We've been having the same argument since the dawn of mankind. AI is the new AR.