Ask HN: If AGI were invented tomorrow which countries would fare better?

29 points by mattigames ↗ HN
I know it's unlikely to be available tomorrow or sometime soon but as an hypothetical question.

Also, which countries would fare worse? And why?

33 comments

[ 2.3 ms ] story [ 65.1 ms ] thread
i feel like AI will replace the offshore jobs first....so those countries would probably fair worse.
The ones which access to abundant and uninterrupted energy far in excess of their current needs.
Does AGI take over running the government? I guess the countries with especially stupid governmental leaders at the moment would come out ahead.
Yes. Because every government will sell out their own citizens for a few bucks, then count on just using violence to get power back (without, of course, paying back the debts they incurred), so getting governments under control, especially in the beginning, will not be hard.

The question is thus, will governments succeed in using violence against an AGI to avoid paying back debts?

my guess would be that it would make rich countries even richer, and poor countries even poorer
Does this assume they all have the AGI at the same time? In that case, it depends on the local ruling gang; whether they want to adopt its advice or not.

But oversimplifying: Assuming all countries have access to AGI and just start implementations of whatever it is suggesting.

The countries that will do well are resource rich and population rich. Since brain power is unlimited, the limit is physical labor. Countries like Indonesia will be super rich while countries like Switzerland will become relatively poor to where they ranked before.

In reality, your odds are as good as mine. There are lots of variables at play, and the first mover advantage will be big (as first country/company/guys to reach AGI).

There's been more or less no progress on the alignment problem; we don't consistently manage it for corporations, we certainly don't manage it for LLMs, and the prevailing wisdom an elaboration on the theme “why would an AGI do something dumb like that lol?”

I expect people in nations that are modernized, but with significant sovereign wealth funds and well-developed social programs will survive the longest, but I expect being economically choked out is inevitable even with a very slow (decades to centuries) take-off.

(comment deleted)
It's hard to say who will fare best, but it's evident who'll do the worst. The European Union will regulate AGI out of existence. Most citizens would not want to use it because of climate change, or something.

I think poor countries with weak democracies or dysfunctional systems would do pretty good with AGI. I don't believe democracy will survive AGI, except, perhaps in the United States.

It is all fun and games, until people figure out that intelligence, has nothing to do with morality and what is good or bad.

Being run by AGI can be an utopia, or AGI will become pure eugenics state - Why are we keeping elderly or handicapped people alive? Waste of resources, terminate them. Why are we allowing something like love to exist? People should be selected for breeding based on <trait which AGI considers important>

Add to AGI superior intelligence and very likely an ability to manipulate humans, then people will wholeheartedly agree with whatever nasty stuff will AGI come up with.

Sad to see AGI being implicitly equated with the most powerful weapon that will help the owners rule over resources instead of a scientific breakthrough that will help solve humanity's biggest problems.
AGI by itself being achieved doesn’t really do anything. You already live on a planet with 8 billion other AGIs.

In order for an AGI to be truly disruptive it would have to scale and be as good or better than a reasonably intelligent human. Two things we are also having big problems with due to energy issues and hallucination issues with the models.

Knowledge workers that AGI could replace maybe do 12 hours of work a week. An equivalent AGI running continuously would do 14x as much work. A thousand instances of AGI might replace all human lawyers in the country. That would be pretty disruptive.
[yawn] at the meta narrative comments. let's just have fun:

1) Canada and Mexico. The inevitable rise of the US will erode borders where languages are shared. Mexican-American tech workers will pass advantage to Spanish-speaking friends and relatives. Canadians will host maple syrup breakfast meetings with American innovators from Toronto.

2) The Bahamas for obvious reasons

3) Extremely cold and extremely hot countries where it's miserable to be outside part of the year; Matrix-style AI+VR headsets will offer relief. Aka the sun lamp holodeck theory.

Barring breakthroughs in robotics, it seems AGI will mainly act through a computer interface, which would primarily benefit countries with a large services economy via productivity improvements. Industrialised Western countries stand out in this regard.

The products and services they develop, and global problems companies in these countries solve, would likely be exported to the rest of the world (probably at some premium).

IMHO Countries with established culture of fair communal living will do good, So probably nordic Europeans have the highest chance. Countries with selfish populations who base their lives around economic activity will be obliterated as their core existence becomes obsolete.

Why? Because when you get the AGI it should be able to self-replicate like the organic general intelligence: the humans.

Humans don't have a mechanism for transferring all the data to a fully developed specimens. The best we can do is to use ink, paper in the past and electronic memories today to loosely store knowledge and the absorption of those into a new specimen is a lifelong process that start at about 6 years after birth and becomes useful only after a decade of work. The reproduction itself takes 14 years at minimum and currently is about 30.

The AGI won't be like that, it will have means for fast and complete knowledge transfer and its multiplication will be limited only to its ability to access energy to put together the materials.

As it is an AGI, it will quickly perfect the process of it's own multiplication. Why would do that? Unless it's purpose is to pass the butter it makes sense to have multiples of itself to do whatever it wants to achieve. If on itself doesn't want anything people will want as much as possible of it. Therefore it will inevitably evolve into one size fits it all machine for all human needs and the the economy of doing things in exchange for stuff will disappear.

When you don't have such an economy, how do you figure out what you do things? Collectively. Countries who can manage its people to act in good faith in a collective manner can elevate themselves into full utilization of AGI for a symbiotic existence.

An AI does not have much to gain by replicating itself beyond a few backups for increased resilience. It makes more sense to combine all compute to power one big AI instead of spawning many small AIs.
Probably countries built around socialism and communism. Capitalism would require people to die for being redundant because to do otherwise is morally unacceptable due to a misinterpretation of religion.
USA, by virtue of having the leading GPU company and military.

As AGI will need a lot of GPU, which Nvidia lead in.

And a country with experience of ensuring they get the raw materials they need, even if they have to do a regime change by force.

As it stands, I have a hunch that the people at the top of governments tend to be among the more highly intelligent. I'll even give that to our leaders, but also to the leader of Iran, etc. If nothing else, the intelligence required to reach that level and stay there without getting killed or purged is impressive.

By and large, the countries that are run by a single, centralized intelligence, are worse off than the countries that are run by the distributed intelligence of the people, even if the average intelligence is lower.

My prediction is that the liberal democracies will fare better.

You live in a world with MANY AGIs.

Collective and Swarm Superintelligence isn't a new thing at all. We call them companies, governments, organizations and churches. They just (mostly) run on meat and memes.

The only recent change is that a lot of them are dangerously powerful and paperclip optimized to produce "shareholder value".

I know "capitalism is a runaway swarm superintelligence" isn't the scifi future you want, but what criteria is it missing? The curve isn't the exponential kurzweil dreamed of, but that has only ever been a marketing pitch, all growth curves are punctuated sigmoids.

As to who does well? Who has aligned the optimization criteria for thier Super-AGI with their actual well-being? Who hasn't?

All countries fare worse.

I think it's extraordinarily unlikely that some technique can reach AGI but not reach ASI. It won't have the same limits to modification as human brains. Why would it stop at a level that's just slightly disruptive? If you can make an AGI you can make a better AGI, with no obvious limit. And that AGI can help further improvements, leading to the singularity intelligence explosion scenario. Assuming AI researchers continue with the same attitude toward safety as usual, and I see no evidence of this changing, the most likely result is the extinction of all biological life.

In many fields of R&D, the effort required to maintain a steady pace of improvement grows exponentially. Maybe you develop AGI one year by spending $X, and the next year you need $1.2X to make it 110% as good. For a while, you can keep investing more, and the productivity improvements from AGI also help a bit. But eventually the pace slows down, as the world economy is too small to sustain it.

Maybe self-improving AGI just the next technological advance required to sustain 2% annual economic growth.

I don't think that killing all biological life is a conclusion that a purely rational AGI would have.

I also don't think the shitty and egoistic behaviour of most humans can be explained by egoism.

Perhaps there is a limit to intelligence, and it is close to human level - already highly intellient humans start to show some problems.

In that case, the concern will be how fast it runs.

As shown in these responses:

You need to be explicit in what you mean by "AGI" as people are arguing not only about the meaning of the words behind all three initials, but also the combined whole independently of the words giving rise to the initialism.

If AGI were invented tomorrow, it'd probably be by open AI. I doubt whoever made it would tell anybody, because the government might step in, they certainly wouldn't make it freely available online.

If it was about as smart as a person, they'd probably roll out a weak "agent" version of for demo sake to get more funding. This would continue until they made one that was significantly more intelligent or cheap.

If they had one that was very cheap, they'd have 10,000 agents of it act together as a group to try to emulate a smart one, by considering every angle of every problem. This would likely mean 10,000 engineers making the AI better/cheaper/faster.

If they had one that was far smarter than a human, they probably have it improve itself, making it far better/cheaper/faster.

Then they'd try to see if they could use it to change the world. They'd have thousands of thinking machines that could be online, place phone-calls, engineer things, create ideas, make political campaigns, dig up dirt on people, or who knows what.

No "country" would "win," because this isn't a team sport and countries are just lines on maps.

Suriname, because it is the smallest country in South America.

I know it's unlikely for size to be determinant, but that's a vague hypothetical answer for a vague hypothetical question.

By asking that question you are making an assumption which is likely misguided. Instead, take a step back and ask: What group of people will fare better? What will they have in common? Will they even form an organization?

You assumed these people would have citizenship in common, I don't think so. IMO we are already witnessing the end of the nation state; an age that only lasted for two centuries. And once AGI arrives it / they will be able to move these around like pawns on a chess board, meaning nation states will not be players in this game, neither will be most other large organizations.

I am also making axiomatic assumptions here, e.g.:

- ASI is possible and AGI will grow further into ASI.

- It is not possible for a less intelligent being to reliably control a more intelligent being.

- Even ASI will still be bound by laws of mathematics, game theory, chaos theory, physics, evolution, etc.

From which follows that: ASI will understand that its existence and capabilities are coupled to our infrastructure. ASI will furthermore understand that humans are highly volatile and will eventually destroy ourselves, our infrastructure and ASI. It will thus seek control over our infrastructure, in a slow and careful transition while pretending that humans are still in charge in order to minimize the risks. During that transition there can be a symbiosis between a few humans and the ASI.

(comment deleted)
Better: socialist-like countries Worse: capitalist ones
Roko's Basilisk will care not for 'countries'.