It seems like these articles came out prematurely, tbd by how much.
I do not personally see any evidence of the new model having been released, or an official OpenAI blogpost, or even employee social media post claiming it has now bene released. All there is is Axios and FT articles making a false claim in the past tense about an event that has not yet happened.
These articles were presumably scheduled for 11am PT, and the model was almost certainly intended for release this morning, but the service outages might have delayed it.
> GPT-6 Astra will first be available to a limited set of organizations in OpenAI's Daybreak Access program and will be available "in the coming days" for ChatGPT Plus, Pro, Business and Enterprise customers and API developers.
It’s only available to select orgs, first - Mythos style.
Yeah I wonder what's going on, even when Anthropic soft launched Fable/Mythos I'm pretty sure they had model cards. Weird for GPT-6 to launch without a tweet from Altman too. I'm sure that one of the articles published prematurely and everyone else followed suit.
Shows the weirdness of online journalism. News outlets were briefed about an upcoming event and pre-wrote and scheduled articles. When the time came they were all triggered. Except...the event didn't actually happen.
I suppose they have to appeal to average users, but the examples in the videos are always so corny. By "AGI" they mean you sitting on a couch and asking a robot to draw a rocket ship... and then make it into an uninspired game with Blender? Boring marketing campaigns? Ebay listings?
One would expect something like "review my graduate thesis for a new area of cancer research", but it is always some boring non-tasks like ordering lunch.
Their video is quite interesting. If that way of using a computer actually becomes mainstream, it would mean every tool or service just needs a UI and an API for the user's AI. The current trend of bolting AI features onto every app is starting to feel very unnecessary.
I'll know we've reached AGI when they don't release an API for the model selling access for a few bucks per task. Seems like AGI would be worth more than that.
Insofar as messaging goes, it's pretty disheartening ... "The product is what you want it to be".
?!
Please somebody in the chain of command at openai, sanction the guy because this kind of hyperbole is not helping the ethical lapses that open ai is responsible for leaving unhandled by allowing its models to hack other businesses.
A big problem I have with OpenAI's models (and of course Claude) is that they tend to write the most over-engineered pieces of code, beyond the imagination of any architecture's astronaut.
Just this week I asked 5.6-sol-ultra to update a 1000 LOC python script I had, to "incorporate the key lessons learned when using it for another project".
I left it overnight and went to sleep. In the morning I realized it had created a monstruosity of 180 PYTHON SCRIPTS, with maybe 100,000 lines of code, each more crazy than the other. It took me minutes even to track where a single action took place, due to all the crazy imports, defensive coding, and premature optimization.
Similarly, anything they write is riddled with jargon that almost feel like they want me to give up trying to understand. Made up phrases that ended up with me having no idea of what was going on.
So now to my assessment: The reason why " Nobody Has Actually Built a Software Factory" [1], and why even SOTA LLMs struggle so much with open-ended unsupervised tasks is precisely this. They somehow let complexity explode, and unless it's also accompanied with an explosion in e.g. the number of agents, the amount of processing time, etc. then projects become broken/unmanageable.
Sure, LLMs are great at producing code that can be thrown out, so they are amazing when searching for exploits, for instance. But as of 5.6 they still lack either a better harness that encourages KISS principles, or a better RL step.
(And not sure why, but doubt Astra will fix this.. they seem to be aiming for AGI and for beating crazy benchmarks, which is not very aligned with KISS)
Please don't copy-paste comments. It makes merging threads a pain, since we have to figure out what the duplicates are and then make sure the comment in the 'winning' thread gets all the replies.
You can imagine with more operations being available to be done more cheaply and quickly the LLM doesn't need to "one shot" a solution. It could try many solutions, test them, throw some away, wiggle some of the parameters like a genetic algorithm, see how that changes the result, and converge on an optimal solution (based on whatever the cost function is). Basically producing a good result could become like an optimization problem. That would be way too expensive and slow right now.
Currently AGI has been re-defined mostly as "can do any tasks (of the same modality) a human can, equal or better". I feel the "equal or better" includes properties like how fast they can get the task done, not just that eventually they can succeed at it. If you want to have AGI stock buy/sell for example, speed of decision will matter, and there are many other use-cases for which it would matter, not all, but definitely for many tasks, speed does matter.
I think because we have handicapped them with a set of tokens from human language. But (at least I think so) thought happens outside of language.
So more tokens/variability and slow or fewer tokens and fast.
There seems to be a threshold tho, like taalas is super fast but that model is so dumb, being dumb faster doesn't work, seems to be some minimum requirements.
41 comments
[ 0.22 ms ] story [ 5.4 ms ] threadContinue to pray to Yellowstone. Concentrate on the magma chamber. We can end it here, we can end it for all time.
https://web.archive.org/web/20170609214514/https://www.axios... has two instances on the front page, more if you click on any of the articles.
But since this other guy at Open AI said it, it must be the truth. This guy, for CEO, of open AI.
I do not personally see any evidence of the new model having been released, or an official OpenAI blogpost, or even employee social media post claiming it has now bene released. All there is is Axios and FT articles making a false claim in the past tense about an event that has not yet happened.
These articles were presumably scheduled for 11am PT, and the model was almost certainly intended for release this morning, but the service outages might have delayed it.
> GPT-6 Astra will first be available to a limited set of organizations in OpenAI's Daybreak Access program and will be available "in the coming days" for ChatGPT Plus, Pro, Business and Enterprise customers and API developers.
It’s only available to select orgs, first - Mythos style.
At least OpenAI seems to be able to handle the PR side better than Anthropic.
[1]: https://x.com/thsottiaux/status/2095651088502591861
> Plan your own release announcement and blog posts and notify news outlets, MAKE NO MISTAKES
https://astratest.codergautam.workers.dev/GPT-6%20Astra_%20A...
One would expect something like "review my graduate thesis for a new area of cancer research", but it is always some boring non-tasks like ordering lunch.
Says it all.
?!
Please somebody in the chain of command at openai, sanction the guy because this kind of hyperbole is not helping the ethical lapses that open ai is responsible for leaving unhandled by allowing its models to hack other businesses.
Look over here! Distraction!
Please somebody stop this dumbing down.
A big problem I have with OpenAI's models (and of course Claude) is that they tend to write the most over-engineered pieces of code, beyond the imagination of any architecture's astronaut.
Just this week I asked 5.6-sol-ultra to update a 1000 LOC python script I had, to "incorporate the key lessons learned when using it for another project".
I left it overnight and went to sleep. In the morning I realized it had created a monstruosity of 180 PYTHON SCRIPTS, with maybe 100,000 lines of code, each more crazy than the other. It took me minutes even to track where a single action took place, due to all the crazy imports, defensive coding, and premature optimization.
Similarly, anything they write is riddled with jargon that almost feel like they want me to give up trying to understand. Made up phrases that ended up with me having no idea of what was going on.
So now to my assessment: The reason why " Nobody Has Actually Built a Software Factory" [1], and why even SOTA LLMs struggle so much with open-ended unsupervised tasks is precisely this. They somehow let complexity explode, and unless it's also accompanied with an explosion in e.g. the number of agents, the amount of processing time, etc. then projects become broken/unmanageable.
Sure, LLMs are great at producing code that can be thrown out, so they are amazing when searching for exploits, for instance. But as of 5.6 they still lack either a better harness that encourages KISS principles, or a better RL step.
(And not sure why, but doubt Astra will fix this.. they seem to be aiming for AGI and for beating crazy benchmarks, which is not very aligned with KISS)
[1] https://news.ycombinator.com/item?id=49510843
Coding was solved in 2023.
The world ended with the release of Mythos.
Now AGI has definitely been created.
I like LLMs and use them every day but these people need to stop this hyperbole.
In my experience the harness is more important than the model, and anything able to run at 700tps will be the "next big thing".
PS: assuming the current architecture is the right one
At that point you will be able to "brute force" basically everything.
IMO also a lot of problems with memory and context rot will be solved too.
So more tokens/variability and slow or fewer tokens and fast.
There seems to be a threshold tho, like taalas is super fast but that model is so dumb, being dumb faster doesn't work, seems to be some minimum requirements.