“We are now confident we know how to build AGI as we have traditionally understood it. We believe that, in 2025, we may see the first AI agents “join the workforce” and materially change the output of companies.”
Either way, the AI bubble is going to start popping if he can’t demonstrate meaningful progress - into the realm of making decisions and taking actions - within the next year.
Almost anything said from here on in will be an appeal to authority, but putting the logical fallacy issue to one side, that's a pretty lame chart. The y axis is highly contestable and essentially undefined.
Can they square “we know how to build AGI” with “a bunch of our executive team has left in the past 12 months when they clearly knew what he was talking about”? Why would you leave if AGI was just around the corner?
(Which is to say, it isn’t. This has to be LLMs: the final frontier)
That's the most damning thing: they have no warchest from LLM's, no vast profits to propel them to the next big thing. It HAS to be LLM's to AGI or bust if Openai even has a shot at it's foundational mission. If they don't make back their VC money, they won't even be able to fundraise for the next big thing when it comes, investors aren't going to double down when OAI has has basically dropped their initial project with no real returns
From the frankly delusional levels of hype they've been pushing, they took a wrong turn and they don't have the cash to double back
It should be nothing personnel in the sense of LLMs not being considered people. It's seeming that it will more likely be nothing personnel in terms of nothing personnel, kid.
The most interesting argument is about the ratio of the marginal value of labor to the marginal value of everything else. Let's call it MVLE.
In prehistory, land was plentiful and hunting/gathering skill was scarce, so MVLE was high. In the middle ages, the population had exploded and arable land had become scarce. MVLE dropped dramatically. In the industrial revolution, capital accumulation began, and MVLE began rising. Once labor costs were high enough, productivity became king, and services and information goods became more prominent. MVLE rose much further.
Note the seemingly accidental correlation between MVLE, self-determination and human rights.
Now we're at a crossroads. There's a possibility that MVLE might completely bottom out. One edge outcome is a world with 100 trillionaires, 1000000 concubines, a bunch of butlers and hair stylists, and no other humans.
The key question is: whose utility will be maximized? It's clear that democracy's cracks have turned into fractures. Half of the population has an IQ below 100 and can be gulled into voting themselves into oblivion.
> Half of the population has an IQ below 100 and can be gulled into voting themselves into oblivion.
While technically true, I’d caution against assuming IQ is at all representative of average practical or applied intelligence. There’s plenty of writing out there outlining the issues with IQ as a measurement.
I also think the problems we’re struggling with—insofar as the ethics of utilization of AI—boil down to humanity’s overall inability thus far to reach consensus on what we want to optimize our society for: the most good for the most people, the most good for some people, or something completely orthogonal to good or bad for any number of people (pursuit of knowledge, culture, unity, whatever).
Regardless, a lot of folks seem to have good and widely agreed upon ideas of what we do not want and I’d love to see more conversations around how we prevent the worst case scenarios given the current political and economic environment.
> I’d caution against assuming IQ is at all representative of average practical or applied intelligence
I don't necessarily disagree. Unfortunately, demagoguery has paid off handsomely in recent years. It has been refined as a discipline to the point that the "self-destruction gullibility threshold" might actually be much higher than 100.
Strong words! And the other frontier labs won't be far behind them. The world is about to change massively.
I don't see why people are calling this "vague". It's not an announcement of GPT-5 or anything, but this seems pretty specific to me. It's good to have confirmation that OpenAI doesn't see any serious barriers to achieving AGI in the next year or two. Lots of people arguing otherwise these days and this is a direct refutation.
And, if AGI is not achievable by OpenAI in the next two years, then this is about as close as you can slice fraud with a team of lawyers reviewing every public statement.
A whole lot of words that didn't say much about specifics of the past or specifics of the future, just pablum and positive spins. It read as if he had an LLM help out (derogatory).
"We are beginning to turn our aim beyond that, to superintelligence in the true sense of the word. We love our current products, but we are here for the glorious future. With superintelligence, we can do anything else. Superintelligent tools could massively accelerate scientific discovery and innovation well beyond what we are capable of doing on our own, and in turn massively increase abundance and prosperity."
Claiming superintelligence in this post in this form with how little LLMs are able to consistently be accurately true is beyond wishful thinking, entering magical, though throughout it all is still the stink of Fraud.
There you go. His blog post is literally talking about what will be discussed at the Annual WEF meeting:
From [0]:
> "While nearly 40% of global employment is exposed to AI, it is anticipated that most of this impact will be to augment work rather than to fully automate existing occupations."
The problem here is that once these AI agents as Sam just said “join the workforce”, eventually those jobs are replaced and there will be no alternative for those lost jobs. Starting with customer service and it will move up and so on.
Both of them are now coining the start of this as "The Intelligence | Intelligent Age".
> Claiming superintelligence in this post in this form with how little LLMs are able to consistently be accurately true is beyond wishful thinking, entering magical, though throughout it all is still the stink of Fraud.
Completely. I eagerly anticipate the lawsuits when OAI crumbles financially and stakes holders want restitution. He promises far beyond what any evidence shows they have developed.
I would guess that a gazillion dollars of other people's money is hoping that he doesn't put his foot in his mouth.
So there'd probably be staff/consultants who you'd want to review these pieces before they're published.
There might also be staff/consultants who have particular goals of the writing to begin with, and who might even write the entire thing themselves, or at least itemize talking points.
To be fair I think Sam's belief is very genuine here. I remember way back in the day when asked how they would make money, he said "we will just ask the agi". People laughed then but that future seems closer than when he responded with that?
Having said that I don't think conscious AGI is possible in this path. It would probably be cracked by the Chinese because the American way is brute force. The Chinese way is more yin yang and lesser investments (forced hand maybe) which will force research on more energy conservative methods.
It's unfortunate because Sam didn't used to be this way[0]. Once you reach such a high position, saying anything of substance appears to be too great a risk.
> We are now confident we know how to build AGI as we have traditionally understood it. We believe that, in 2025, we may see the first AI agents “join the workforce” and materially change the output of companies.
This goes with the same agenda with the World Economic Forum (WEF) of "Collaboration for the Intelligent Age" [0] which Sam is also attempting to coin this with a similar title (The "Intelligence" / "Intelligent" Age). [1]
It will be no surprise the he will be invited to tell us all about how AGI will bring the utopia of Universal Basic Income (UBI) to everyone and save the world for the "benefit of humanity".
The truth is, "AGI" is a massive scam to raise more money to inevitably replace workers with AI and race all of it to zero, without any alternative for those lost jobs.
Sam Altman is just yet another pawn used by billionaires to make the billionaire class even richer, push de-regulation propaganda, and push awful neo-liberalism economics.
Naturally no comments on change in governance or profit structure in these reflections.
He comments on the founding of OpenAI as though OpenAI the, currently, capped-profit company and OpenAI the non-profit which today controls it are the same thing. They are not and they are planned to be split, a split that cannot possibly be justifiable under the OpenAI (the non-profit) charter.
As I watch OpenAI's structural development over time, it becomes increasingly clear that the wildly incompetent board of OpenAI had something justifiable in their firing of Sam.
>We are now confident we know how to build AGI as we have traditionally understood it
But we don't even have good definitions to work with. Does he mean AGI as in "sentience", AGI as in "superintelligence", AGI as in "can do everything textual (text in, text out) a 95th percentile human can do", or "can do everything a human on a computer can do" (closed-loop interaction with compiler, debugging, etc.).
He means "AGI is whatever it is will get me funding". AGI will be one thing to researchers, another to finance, another to your Grandma, and he will claim it to be here but also just around the corner.
FWIW OpenAI themselves give a reasonably specific definition of AGI in their Charter [1]:
highly autonomous systems that outperform humans at most economically valuable work
But I guess the "as we have traditionally understood it" bit from Sam's phrasing may imply that in fact he means something other than OpenAI's own definition?
> Does he mean AGI as in "sentience", AGI as in "superintelligence"
No. OpenAI and Microsoft changed their definitions of AGI to raise more money: [0]
AGI used to mean something years ago, but at this point is a meaningless term. Since the definition is different depending on who you ask.
It may mean "Super Intelligence" to AI researchers, "Raise more money to reach AGI" to investors, "Replace workers with AI Agents" to companies or "Universal Basic Income for all" to governments.
It could mean any of the above.
More accurately, it may also mean: "To raise more and more money to achieve "AGI" and replace all economically valuable work with AI agents (with no alternatives) whilst selling millions of shares to investors to enrich ourselves and changing from a non-profit to a for-profit for the benefit of humanity."
The last definition is what is happening and that looks like a scam.
AGI definition was never about superintelligence - that's ASI. The current LLM is ANI - Artificial Narrow Intelligence. For me AGI would be "95th percentile human on a computer can do".
It doesn't have to be maybe even that smart - if you would take someone with 80 IQ we would still classify them as human level intelligence - definitely smarter than most other animals and such people still useful to society and can provide value with many labour tasks.
I think what many people assume wrongly ChatGPT is not just one 1 AI - it is like millions on instances of such AI at the same time and you can probably scale to hundreds of millions of such Dumb AI. For humans you would have to do hundreds of babies and babysit/train them for minimum 5-10 years to be useful.
To be clear, Altman doesn't say they have achieved AGI, but that they "know how to build AGI". That's the difference between a product and a roadmap. Which are very different things, especially in cutting edge technology. Personally, I don't think they have the pieces to build anything more than an expensive agent that can act on hallucinations just as readily as accurate assessments.
I’m worried to read this in case I get influenced.
I use LLMs everyday including the o1 model and the hype doesn’t match the reality, which is pretty good but like a maximum 15% increase in productivity. How are you meant to get AGI from that?
Let's play the devil's advocate. And let's say Sam is a conman, any definition of AGI or ASI will never arrive.
What has he to gain from all these? Assuming the bubble will burst in the end. Fortune? He will get his salary over the course of the bubble. I am not entirely sure how he can make money if in the end the money runs out.
Fame and Connections?
While I have very little technical idea about anything LLM, I am well versed in the Foundry and Hardware Manufacturing and Supply Chain. Ever since he asked for a Trillion dollar to build Fabs, and Chips for AI I have a very cynical view on him.
> What has he to gain from all these? Assuming the bubble will burst in the end. Fortune? He will get his salary over the course of the bubble. I am not entirely sure how he can make money if in the end the money runs out.
He can make a TON of money by making the company into a for-profit with stocks he can sell. He can do this very very quickly before the bubble pops. This is the real reason he has been pushing for the for-profit change to happen soon. So he doesn't have to rely on salary and instead the equity. As long as he gets out before the burst, he'll have his fortune
Why did/do so many people still invest in/create crypto even when they know it's fraudulent?
Oh yes Thank you for the correction. I remember it was some insanely ridiculous number in the trillion. And then talking about instead of UBI how about giving Universal Basic Compute.
Ok, well, I guess we're not going to get a proper retrospective for any of the OpenAI stuff for awhile. That's too bad. In the spirit of the post I wish Sam had written, I'll say one thing I learned from watching the show: if you take advice even from your own board, and what they suggested fails, they will still fire you even though it was their advice. So you might as well just always do what you think is right.
>...when any company in an important industry is in the lead, lots of people attack it for all sorts of reasons, especially when they are trying to compete with it.
>...
>We believe in the importance of being world leaders on safety and alignment research
It's interesting to consider the above excerpt, in light of the below excerpt from OpenAI's charter:
>We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions.
I think these are the least insightful comments I’ve seen on HN, maybe ever.
Hating from the sidelines is easy. AGI (or whatever semantics you prefer) is simultaneously:
1: One of the most positively influential technologies developed in human history
2: Magnifies the failures of our current governance structures 1,000 fold.
Adaptation is/will be required, and it’s not going to be easy. But the finish line promises a significantly better future for (potentially) all. Sitting here arguing semantics, complaining about technological evolution (surface level insights, I suggest going a level deeper), or making weird anti-altman statements instead of anything substantive is, well, not interesting.
I don’t think anyone seriously views technological developments as having ultra clear cut start and finish lines.
Engineering/technological innovation is an iterative process and we have steps that provide value and capture value to then generate and provide more value to capture and so on and so forth.
I don’t think having a universal agreement of what AGI is matters, like at all.
>But the finish line promises a significantly better future for (potentially) all
Citation very much needed. Maybe better for the ultrarich owners, but for the billions out of work trying to find how they're going to get food and healthcare? No.
>Adaptation is/will be required, and it’s not going to be easy.
"Some of you may have to die, and that's a sacrifice I'm willing to make" [1]
Sounds like you have an issue with our current governance structures which allows too much value capture to proceed to the ultra wealthy untaxed, despite them relying on the society supported by said taxes to generate their massive wealth.
This will be true whether you’re for/against AGI development. You’re not solving the underlying problem, you’re just kicking the bucket down the road for others to deal with.
AI technology is dramatically accelerating these trends and enabling new ways and is itself a problem.
There is a common trope of claiming technology isn't a problem that simply isn't true. Cheap and available technology absolutely changes models. In the 1960s the Stasi could pay a bunch of people to monitor cameras and microphones but it was incredibly expensive. Cheap cameras, cheap hard drives to store footage indefinitely, and cheap image/voice recognition all enable new horrifying forms of control, surveillance, and punishment even if the actual capability to watch people is not new.
I'm just saying that cameras were always going to become cheap. So were hard drives, and image/voice recognition. This was always going to happen, and always will happen, because it is a net good thing overall. However, it also exposes new means of exploitation that were did not exist before. AKA, technology solves two problems, and creates a brand new one.
It is futile (and dare I say useless) to cry fowl that technological innovation is happening. Instead, we should be revisiting our existing governance structures and remodel them according to the new reality we live in.
You're arguing against things I didn't say at all. You should re-read my initial comment and try to not project <groupsay> onto it.
what is the message? I think it's there are people behind this with human and relatable motives and foibles, the consequence of this change is difficult to apprehend, the main tool they have is to be incremental, and it's just hitting its stride.
the comment about understanding what AGI means was compelling. I'd guess it may be something arrestingly simple, and they have the sense to not be meta about it, or to sound it out with freighted and inadequate words- they will just introduce it as it is.
I used to look forward to his takes. Some of the past posts were genuinely insightful, but now all I hear is the cliched difficult road leading to an AGI whose consequences always seem utterly dire for anyone involved, perhaps except OpenAI.
I still remember being so excited to receive my OpenAI private beta key sometime in 2020. After watching a few videos on developers talking to it, I was incredibly hyped to create something ambitious with it only to quickly become disappointed with its capabilities after trying to wrangle with a bunch of prompts.
So when ChatGPT came out, I thought it was a cool toy with a chat interface skin and nothing more. Before I knew it, AI (and its hype) had invaded a lot of unexpected corners of my life; and as more time passed, with more unexpected and perverse capabilities being discovered, I found it harder and harder to believe in all the utopian visions Sam and others preached.
Hopefully a great super-intelligent god will properly retire me and my family before all our skillsets are automated away.
This is an incredibly vague essay. Let me be more explicit: I think this is a clear sign of a bubble. LLMs are very cool technology, but they are not the second coming. It can't do experiments; it doesn't have an imagination; it doesn't have an ethical framework; its not an agent in any human sense.
LLMs are awesome but I haven't felt significant improvement since the original GP4 (only in speed).
The reasoning models (o1 pro) don't have good reasoning capability when I'm asking things from them, so I don't expect o3 to be significantly better in practice even if they look good on the benchmarks.
Still, I think ARC-AGI benchmark is awesome, and the fact that they are targeting resoning is a good direction (I just think they need to research more techniques / theories).
> LLMs are awesome but I haven't felt significant improvement since the original GP4 (only in speed).
Taking the outside view here - maybe you don't "feel" like it's getting better. But benchmarks aside, there are now plenty of anecdotal stories of scientists and mathematicians using them for actual work. Sometimes for simple labor-saving, but some stories of actually creative work that is partially/wholly based on interactions with LLMs. This is on top of many, many people using this for things like software development, and claiming that they get significant benefits out of these models.
Sonnet 3.6 (the 2022-10-22 release of Sonnet 3.5) is head and shoulders above GPT-4 and anyone who has been using both regularly can attest to this fact.
Reasoning models do reason quite well but you need the right problems to ask them. Don't throw open-ended problems at them. They perform well on problems with one (or many) correct solution(s). Code is a great example - o1 has fixed tricky code bugs for me where Sonnet and other GPT-4 class models have failed.
LLMs are leaky abstractions still - as the user, you need to know when and how to use them. This, I think, will get fixed in the 1-2 years. For now, there's no substitute for hands on time using these weird tools. But the effort is well worth it.
I’d argue that most coding problems have one truly correct solution and many many many half correct solutions.
I personally have not found AI coding assistance very helpful, but from blog posts by people who do much of the code I see from Claude is very barebones html templates and small scripts which call out to existing npm packages. Not really reasoning or problem solving per se.
I’m honestly curious to hear what tricky code bugs sonnet has helped you solve.
It’s led me down several incorrect paths, one of which actually burned me at work.
>LLMs are awesome but I haven't felt significant improvement since the original GP4 (only in speed).
Absolutely disagree. Are you using LLMs for coding? There has been a 10x (or whatever) improvement since GPT4.
I causally tracked the ability of LLMs to create a processore design in a HDL since 2023. I stopped in June of 2024, because Sonnet would basically oneshot the CPU, testbench and emulator. There are another substantional update of Sonnet in October 2024.
120 comments
[ 3.0 ms ] story [ 217 ms ] threadThat's going to be very hard to argue.
What he's selling is brand Altman.
Either way, the AI bubble is going to start popping if he can’t demonstrate meaningful progress - into the realm of making decisions and taking actions - within the next year.
Frankly, I think he’s exaggerating.
Reddit is not your friend in the citation stakes.
These comments:
> Now do the same for other evaluations, remove the o family, nudge the time scale a bit, and watch the same curve pop out.
> This is called eval saturation, not tech singularity. ARC-2 is already in production btw.
A reply:
> You act like that isnt significant, people just hand wave "eval saturation"
> The fact that we keep having to make new benchmarks because ai keep beating the ones we have is extremely significant.
Agree with this. The pace has been mind boggling.
The pace has been impressive, but until hallucinations are addressed the more faith and capital you put behind an AI agent, the more you risk losing.
Note that they have an incentive to not get a system classified as AGI.
(Which is to say, it isn’t. This has to be LLMs: the final frontier)
From the frankly delusional levels of hype they've been pushing, they took a wrong turn and they don't have the cash to double back
In prehistory, land was plentiful and hunting/gathering skill was scarce, so MVLE was high. In the middle ages, the population had exploded and arable land had become scarce. MVLE dropped dramatically. In the industrial revolution, capital accumulation began, and MVLE began rising. Once labor costs were high enough, productivity became king, and services and information goods became more prominent. MVLE rose much further.
Note the seemingly accidental correlation between MVLE, self-determination and human rights.
Now we're at a crossroads. There's a possibility that MVLE might completely bottom out. One edge outcome is a world with 100 trillionaires, 1000000 concubines, a bunch of butlers and hair stylists, and no other humans.
The key question is: whose utility will be maximized? It's clear that democracy's cracks have turned into fractures. Half of the population has an IQ below 100 and can be gulled into voting themselves into oblivion.
While technically true, I’d caution against assuming IQ is at all representative of average practical or applied intelligence. There’s plenty of writing out there outlining the issues with IQ as a measurement.
I also think the problems we’re struggling with—insofar as the ethics of utilization of AI—boil down to humanity’s overall inability thus far to reach consensus on what we want to optimize our society for: the most good for the most people, the most good for some people, or something completely orthogonal to good or bad for any number of people (pursuit of knowledge, culture, unity, whatever).
Regardless, a lot of folks seem to have good and widely agreed upon ideas of what we do not want and I’d love to see more conversations around how we prevent the worst case scenarios given the current political and economic environment.
I don't necessarily disagree. Unfortunately, demagoguery has paid off handsomely in recent years. It has been refined as a discipline to the point that the "self-destruction gullibility threshold" might actually be much higher than 100.
I don't see why people are calling this "vague". It's not an announcement of GPT-5 or anything, but this seems pretty specific to me. It's good to have confirmation that OpenAI doesn't see any serious barriers to achieving AGI in the next year or two. Lots of people arguing otherwise these days and this is a direct refutation.
"We are beginning to turn our aim beyond that, to superintelligence in the true sense of the word. We love our current products, but we are here for the glorious future. With superintelligence, we can do anything else. Superintelligent tools could massively accelerate scientific discovery and innovation well beyond what we are capable of doing on our own, and in turn massively increase abundance and prosperity."
Claiming superintelligence in this post in this form with how little LLMs are able to consistently be accurately true is beyond wishful thinking, entering magical, though throughout it all is still the stink of Fraud.
From [0]:
> "While nearly 40% of global employment is exposed to AI, it is anticipated that most of this impact will be to augment work rather than to fully automate existing occupations."
The problem here is that once these AI agents as Sam just said “join the workforce”, eventually those jobs are replaced and there will be no alternative for those lost jobs. Starting with customer service and it will move up and so on.
Both of them are now coining the start of this as "The Intelligence | Intelligent Age".
[0] https://www.weforum.org/meetings/world-economic-forum-annual...
Completely. I eagerly anticipate the lawsuits when OAI crumbles financially and stakes holders want restitution. He promises far beyond what any evidence shows they have developed.
So there'd probably be staff/consultants who you'd want to review these pieces before they're published.
There might also be staff/consultants who have particular goals of the writing to begin with, and who might even write the entire thing themselves, or at least itemize talking points.
Having said that I don't think conscious AGI is possible in this path. It would probably be cracked by the Chinese because the American way is brute force. The Chinese way is more yin yang and lesser investments (forced hand maybe) which will force research on more energy conservative methods.
The key to conscious AI is energy conservation.
[0] https://m.youtube.com/watch?v=sYMqVwsewSg
And Gates
( https://en.wikipedia.org/wiki/The_Metamorphosis )
This goes with the same agenda with the World Economic Forum (WEF) of "Collaboration for the Intelligent Age" [0] which Sam is also attempting to coin this with a similar title (The "Intelligence" / "Intelligent" Age). [1]
It will be no surprise the he will be invited to tell us all about how AGI will bring the utopia of Universal Basic Income (UBI) to everyone and save the world for the "benefit of humanity".
The truth is, "AGI" is a massive scam to raise more money to inevitably replace workers with AI and race all of it to zero, without any alternative for those lost jobs.
[0] https://www.weforum.org/meetings/world-economic-forum-annual...
[1] https://ia.samaltman.com/
He comments on the founding of OpenAI as though OpenAI the, currently, capped-profit company and OpenAI the non-profit which today controls it are the same thing. They are not and they are planned to be split, a split that cannot possibly be justifiable under the OpenAI (the non-profit) charter.
As I watch OpenAI's structural development over time, it becomes increasingly clear that the wildly incompetent board of OpenAI had something justifiable in their firing of Sam.
But we don't even have good definitions to work with. Does he mean AGI as in "sentience", AGI as in "superintelligence", AGI as in "can do everything textual (text in, text out) a 95th percentile human can do", or "can do everything a human on a computer can do" (closed-loop interaction with compiler, debugging, etc.).
highly autonomous systems that outperform humans at most economically valuable work
But I guess the "as we have traditionally understood it" bit from Sam's phrasing may imply that in fact he means something other than OpenAI's own definition?
[1] https://openai.com/charter/
Highly autonomous systems already outperform humans for the vast majority of the economically valuable work of the 1400s economy.
No. OpenAI and Microsoft changed their definitions of AGI to raise more money: [0]
AGI used to mean something years ago, but at this point is a meaningless term. Since the definition is different depending on who you ask.
It may mean "Super Intelligence" to AI researchers, "Raise more money to reach AGI" to investors, "Replace workers with AI Agents" to companies or "Universal Basic Income for all" to governments.
It could mean any of the above.
More accurately, it may also mean: "To raise more and more money to achieve "AGI" and replace all economically valuable work with AI agents (with no alternatives) whilst selling millions of shares to investors to enrich ourselves and changing from a non-profit to a for-profit for the benefit of humanity."
The last definition is what is happening and that looks like a scam.
[0] https://archive.ph/pmudc
Notice the lawyerly « AGI as we have traditionally understood it »
https://www.theverge.com/2024/12/26/24329618/openai-microsof...
It doesn't have to be maybe even that smart - if you would take someone with 80 IQ we would still classify them as human level intelligence - definitely smarter than most other animals and such people still useful to society and can provide value with many labour tasks.
I think what many people assume wrongly ChatGPT is not just one 1 AI - it is like millions on instances of such AI at the same time and you can probably scale to hundreds of millions of such Dumb AI. For humans you would have to do hundreds of babies and babysit/train them for minimum 5-10 years to be useful.
I use LLMs everyday including the o1 model and the hype doesn’t match the reality, which is pretty good but like a maximum 15% increase in productivity. How are you meant to get AGI from that?
I'm not even a big believer, but depended on how you define AGI, it's a range from not in a life-time to might happen by 2030.
Bit surprised about the AGI part and also the agent „join workforce“ comment. I thought it’s their policy to not anthropomorphize ?
What has he to gain from all these? Assuming the bubble will burst in the end. Fortune? He will get his salary over the course of the bubble. I am not entirely sure how he can make money if in the end the money runs out.
Fame and Connections?
While I have very little technical idea about anything LLM, I am well versed in the Foundry and Hardware Manufacturing and Supply Chain. Ever since he asked for a Trillion dollar to build Fabs, and Chips for AI I have a very cynical view on him.
He can make a TON of money by making the company into a for-profit with stocks he can sell. He can do this very very quickly before the bubble pops. This is the real reason he has been pushing for the for-profit change to happen soon. So he doesn't have to rely on salary and instead the equity. As long as he gets out before the burst, he'll have his fortune
Why did/do so many people still invest in/create crypto even when they know it's fraudulent?
This applies to other leadership roles as well.
>...
>We believe in the importance of being world leaders on safety and alignment research
It's interesting to consider the above excerpt, in light of the below excerpt from OpenAI's charter:
>We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions.
https://openai.com/charter/
OpenAI doesn't claim to be leaders in safety and alignment research.
They "believe in the importance" of being leaders in safety and alignment research. For whatever that's worth.
But they do acknowledge themselves as the leading AI company.
Is it really in our interest as a species for the leading AI company to merely "believe in the importance" of leadership in safety and alignment?
Among the "all sorts of reasons" for people to attack the leading AI company, this strikes me as a fairly legitimate one. Just saying.
Also -- I notice that OpenAI seems to be criticized more than leading companies in other industries.
If maintaining your lead isn't in the interest of your stated mission statement... maybe you shouldn't actually be working to maintain that lead?
Did Sam or OpenAI ever publicly respond to Jan Leike's comments when he left? (Former head of alignment) https://threadreaderapp.com/thread/1791498174659715494.html
See also: https://openasteroidimpact.org/
Hating from the sidelines is easy. AGI (or whatever semantics you prefer) is simultaneously: 1: One of the most positively influential technologies developed in human history 2: Magnifies the failures of our current governance structures 1,000 fold.
Adaptation is/will be required, and it’s not going to be easy. But the finish line promises a significantly better future for (potentially) all. Sitting here arguing semantics, complaining about technological evolution (surface level insights, I suggest going a level deeper), or making weird anti-altman statements instead of anything substantive is, well, not interesting.
The entire reason that people are hating from the sidelines is because there's no clear finish line.
"Just wait for AGI" is as unsubstantial as the comments you are criticizing.
I don’t think anyone seriously views technological developments as having ultra clear cut start and finish lines.
Engineering/technological innovation is an iterative process and we have steps that provide value and capture value to then generate and provide more value to capture and so on and so forth.
I don’t think having a universal agreement of what AGI is matters, like at all.
Citation very much needed. Maybe better for the ultrarich owners, but for the billions out of work trying to find how they're going to get food and healthcare? No.
>Adaptation is/will be required, and it’s not going to be easy.
"Some of you may have to die, and that's a sacrifice I'm willing to make" [1]
[1]: https://www.youtube.com/watch?v=hiKuxfcSrEU
This will be true whether you’re for/against AGI development. You’re not solving the underlying problem, you’re just kicking the bucket down the road for others to deal with.
There is a common trope of claiming technology isn't a problem that simply isn't true. Cheap and available technology absolutely changes models. In the 1960s the Stasi could pay a bunch of people to monitor cameras and microphones but it was incredibly expensive. Cheap cameras, cheap hard drives to store footage indefinitely, and cheap image/voice recognition all enable new horrifying forms of control, surveillance, and punishment even if the actual capability to watch people is not new.
We're saying the exact same thing.
I'm just saying that cameras were always going to become cheap. So were hard drives, and image/voice recognition. This was always going to happen, and always will happen, because it is a net good thing overall. However, it also exposes new means of exploitation that were did not exist before. AKA, technology solves two problems, and creates a brand new one.
It is futile (and dare I say useless) to cry fowl that technological innovation is happening. Instead, we should be revisiting our existing governance structures and remodel them according to the new reality we live in.
You're arguing against things I didn't say at all. You should re-read my initial comment and try to not project <groupsay> onto it.
the comment about understanding what AGI means was compelling. I'd guess it may be something arrestingly simple, and they have the sense to not be meta about it, or to sound it out with freighted and inadequate words- they will just introduce it as it is.
good luck.
So when ChatGPT came out, I thought it was a cool toy with a chat interface skin and nothing more. Before I knew it, AI (and its hype) had invaded a lot of unexpected corners of my life; and as more time passed, with more unexpected and perverse capabilities being discovered, I found it harder and harder to believe in all the utopian visions Sam and others preached.
Hopefully a great super-intelligent god will properly retire me and my family before all our skillsets are automated away.
The reasoning models (o1 pro) don't have good reasoning capability when I'm asking things from them, so I don't expect o3 to be significantly better in practice even if they look good on the benchmarks.
Still, I think ARC-AGI benchmark is awesome, and the fact that they are targeting resoning is a good direction (I just think they need to research more techniques / theories).
Taking the outside view here - maybe you don't "feel" like it's getting better. But benchmarks aside, there are now plenty of anecdotal stories of scientists and mathematicians using them for actual work. Sometimes for simple labor-saving, but some stories of actually creative work that is partially/wholly based on interactions with LLMs. This is on top of many, many people using this for things like software development, and claiming that they get significant benefits out of these models.
Sonnet 3.6 (the 2022-10-22 release of Sonnet 3.5) is head and shoulders above GPT-4 and anyone who has been using both regularly can attest to this fact.
Reasoning models do reason quite well but you need the right problems to ask them. Don't throw open-ended problems at them. They perform well on problems with one (or many) correct solution(s). Code is a great example - o1 has fixed tricky code bugs for me where Sonnet and other GPT-4 class models have failed.
LLMs are leaky abstractions still - as the user, you need to know when and how to use them. This, I think, will get fixed in the 1-2 years. For now, there's no substitute for hands on time using these weird tools. But the effort is well worth it.
> Code is a great example
I’d argue that most coding problems have one truly correct solution and many many many half correct solutions.
I personally have not found AI coding assistance very helpful, but from blog posts by people who do much of the code I see from Claude is very barebones html templates and small scripts which call out to existing npm packages. Not really reasoning or problem solving per se.
I’m honestly curious to hear what tricky code bugs sonnet has helped you solve.
It’s led me down several incorrect paths, one of which actually burned me at work.
Absolutely disagree. Are you using LLMs for coding? There has been a 10x (or whatever) improvement since GPT4.
I causally tracked the ability of LLMs to create a processore design in a HDL since 2023. I stopped in June of 2024, because Sonnet would basically oneshot the CPU, testbench and emulator. There are another substantional update of Sonnet in October 2024.
https://github.com/cpldcpu/LLM_HDL_Design