There would need to be another paradigm shift if they wanna keep inflating AI usage.
We went from simple chatbots to thinking models which massively exploded token utilization.
We then went from simple thinking models to tool calls and agents. Agents, and particularly long horizon agents, burn truly insane numbers of tokens blowing thinking models well out of the water.
People are trying to do agentic swarms as the next step but I don't think those make sense as of right now. Particularly they are just too insanely expensive and not that useful.
Plus right now the models just aren't good at it. It's like early agents when they first started making tool calls.
Agents are really quite bad at using subagents. They don't really internalize how to deploy them and they also don't utilize them in the ways that make sense (produce planning documents, have verifiable artifacts, break down tasks in ways that minimize risk, recognize model limitations in instruction following, iterate on results, etc).
OpenAI was already projected to burn money at a ludicrous rate and now the news is they are going to burn it even faster. I just don’t see how this ends well for anyone. Regardless of what you think of AI it is apparently entirely too expensive to run. Maybe costs will come down dramatically, but is that at the cost of stagnation in the models? And if that is the case is AI a failure to investors?
At some point in the next few years investors are going to want their returns. The only way I see that happening is though an IPO and then… I don’t know if they have a sustainable business model or one in sight.
Anthropic is capturing exploding enterprise demand via their agentic tools, OpenAI is failing (relatively) to do so. They’re stuck trying to squeeze more $$ out of consumer chatbots that have reached the second knee of the S-curve.
That doesn't seem like the obvious story to me. Normies and even most (non-tech) companies don't really know the difference between chatgpt and claude yet. And they generally don't have opinions or ideas on agentic X.
The obvious story seems to be that OpenAI was reckless and got way ahead of their revenue assuming it would keep hockey-sticking
9 comments
[ 4.3 ms ] story [ 32.7 ms ] threadWe went from simple chatbots to thinking models which massively exploded token utilization.
We then went from simple thinking models to tool calls and agents. Agents, and particularly long horizon agents, burn truly insane numbers of tokens blowing thinking models well out of the water.
People are trying to do agentic swarms as the next step but I don't think those make sense as of right now. Particularly they are just too insanely expensive and not that useful.
Plus right now the models just aren't good at it. It's like early agents when they first started making tool calls.
Agents are really quite bad at using subagents. They don't really internalize how to deploy them and they also don't utilize them in the ways that make sense (produce planning documents, have verifiable artifacts, break down tasks in ways that minimize risk, recognize model limitations in instruction following, iterate on results, etc).
At some point in the next few years investors are going to want their returns. The only way I see that happening is though an IPO and then… I don’t know if they have a sustainable business model or one in sight.
Anthropic is capturing exploding enterprise demand via their agentic tools, OpenAI is failing (relatively) to do so. They’re stuck trying to squeeze more $$ out of consumer chatbots that have reached the second knee of the S-curve.
The obvious story seems to be that OpenAI was reckless and got way ahead of their revenue assuming it would keep hockey-sticking