So it largely sounds like many more people will be able to write software - and will use AI to do it. Existing software engineers will continue to automate their tasks away like they always did, but perhaps at a faster rate.
The impact of AI in other fields seems to be muted.
Ai has become indispensable but maybe not at all cost. My company just had a company-wide meeting to talk about how they're restricting who can use which models and instructing us the "be more responsible with company's tokens". And it's not an small company by any means.
I wonder how a focus on per-token API profits will impact the incentives to improve token efficiency and drive down costs through optimized compute. I suppose as long as a few leading labs are competing, we'll see progress in this regard, but it's certainly less in their interest than it is with a flat subscription pricing model.
There's also increasing pressure from China: note the massive permanent price reductions DeepSeek and Xiaomi announced in the past few days, with the possibility of more around the corner. And there's also the constant release of increasingly capable open weight models.
With deepseek and xiaomi mimo models slashing their prices 99%, I don't see a great future for openai / antrhopic with regards to their 1T valuations. Maybe 1T valuation will be the whole market, West + East.
Great article I know this upsets a lot of people who are used to thinking Anthropic/OpenAI are just lighting cash on fire but they've cornered the market on enterprise who cannot walk away from these $200/month plans
However the valuations are still far far away from actual sanity
They've got, ballpark, $5t to $10t to make back in the next 5 years, or the hardware buildouts will start getting written down.
This means we're going to need $1t+ per year in spending, per year, on tokens. 200m knowledge workers in the world, 30m developers. We're talking about a world where you need 5% of every knowledge workers salary to go into tokens. 20% if you're a developer.
That's a _huge_ shift. Most people I know cite +20%-40% velocity with these tools, against the actual work their company cares about doing. +20% speed for +20% spend isn't going to motivate a trillion dollars a year in spending.
We're not there yet. This is still the upswing of the hype cycle, and unless we figure out how to make developers 2x, 5x, 10x as productive on stuff that matters, this isn't going to play out well.
One thing I genuinely don't understand is these companies are constantly taking in incredibly large amounts of investments, so presumably they're giving up large chunks of equity or these are loans that need to be paid back or they're committing to spending obligations they're very unlikely to be able to meet.
So besides the insane hardware buildouts you're correctly mentioning, I don't understand how anyone that invests in these companies is supposed to make their money back in any sort of reasonable timeframe?
The cynical part of me is looking at what happened to the NASDAQ rules recently where essentially index funds are going to be forced to buy SpaceX shares much earlier than they previously would have (ie, before the price has a chance to reach it's real valuation). Which, um, I'm guessing these stocks are going to drop pretty hard when people start looking at the financials of these companies.
My suspicion is that the point of these IPOs is essentially to dump the bill on the unwilling public by forcing various institutions to buy it (ie, your 401k or pension is buying this shit), and maybe their investors can squeeze some money out of this before the stocks reach an equilibrium that's probably like 1/10th of what they're "valued" at.
So you've got that market. Let's call it the demand BY knowledge workers to do the work. You've also got:
2. The companies themselves buying tokens for operations to make the work more efficent.
e.g. Salesforce agent or Microsoft Office agent or random saas inventory agent. (and if you say those will go away (which I don't believe), it's even more bullish. The tokens just go to someone vibe coding XYZ, which is EVEN MORE than if you were to buy saas because it's SaaS product x Companies that built it instead of just one)
3. The companies SELLING tokens. This is also new markets like schools and small business (e.g. the local gas station buying an inventory tool)
4. The consumers "buying" (I put in quotes because it can be subsidised but the company) through chatgpt, strava, instagram/netflix recommendation, etc.
Local models still take compute, and while it may be cheaper, it is the same argument of on prem vs cloud. No one operates on prem unless you HAVE to for regulatory. Margins will come down and you just spin up a GCP/OpenAI/Anthropic agent.
It may be "cheaper" but rationally its better to pay someone to manage it. Thats why Hetzner only had $367M in revneue (a lot but tiny compared to managed services)
...does anyone have a guess as to the total amount of money spent on software developer salaries each year? What percentage of that would the AI companies need to capture to be profitable?
(I'm not trying to imply that LLMs can replace software engineers, it's just an interesting comparison. If nothing else, I suspect that if the cost of development goes down, demand for custom software will go up.)
I assume the bet is that as you swap humans for machines, this pays for itself. Swap entire devs and teams and frankly, managers, and you make up a lot of 5%’s fast.
If it works. And I’m not sure who is going to buy the stuff the machines produce, but shrug. Presumably some bots click ads for NFT’s that other bots generate.
I understand some startup deciding to take a punt on "this will all work out financially if our new product demonstrably boosts productivity of large sectors of the economy by a breathtaking factor that's incredibly rarely ever happened before in history: 2x.
Sometimes a plucky group of people take a risk, it pays off. If it doesn't work, the company fails.
What I do not understand is: large sectors of the economy all simultaneously taking this punt, with the necessary productivity boost, as you say, far more like: 2x, 5x, 10x
> +20% speed for +20% spend isn't going to motivate a trillion dollars a year in spending.
I'm increasingly realizing this math is wrong, because LLM use is really sticky.
If Anthropic 100x'd prices tomorrow for their best model, so some companies offered 50% salary to keep 100% of your AI usage:
a) There are programmers who would take this deal. They've gotten to the point of doing what feels like even less than 50% of the work, developers were already pretty well paid, so they'll take it.
b) There are companies that'd offer this deal. Even if the only people who are taking this deal are not the best engineers, and the AI output is not the greatest, I think the last 6 or so years have seen a lot of companies realize capitalism is not as competitive as it seems.
They're not worried about putting out a worse product because... frankly, what else are you going to do? CF lay a bunch of people off, support gets awful: well you're probably not building a new Cloudflare in the next few years.
In the meantime the AI will get incrementally better, their market share will grow, and you won't be able to compete without taking the same faustian bargain.
-
Maybe I was just naive but it's making me realize how much we take for granted in the world. Both the quality and relative value of things don't have to go up over time. Quality can go down while prices go up, and nothing will really stop it. Competition should stop it, but competition is really slow and can be interfered with. And as prices go up competition gets really hard.
I just don’t understand how people are getting negative value out of AI or even only 20% productivity boost. I can only conclude that people don’t know how to use agents.
> We're talking about a world where you need 5% of every knowledge workers salary to go into tokens. 20% if you're a developer.
Just realized something: if one worries about losing jobs to AI, token's high unit cost is good news. To say the least, high cost would delay the displacement, if any, right?
In the meantime, someone shared the below on X. I guess the moral of the story is that "good enough" does not just displace software engineers, but also models.
> I Went From $3,000/Month on Claude to $5/Week on DeepSeek
> And honestly?80% of my work is identical.
> For the past two months, I was burning $3-5K monthly on Claude Code. Every idea from design to development to testing - full end-to-end automation, even simulating users to test my products and provide feedback.
> Extremely token-intensive. But Claude's caching sucked, making it insanely expensive.
> Then I discovered DeepSeek V4.
My hope is that hardware improvements (better node densities every 2-3 years, better designs, etc) will pick up the majority of the savings for these companies in the future, assuming LLM performance starts to taper off with diminishing returns.
Is it possible that you are narrowly sizing the opportunity? While PMF does not always mean that early pioneers will be the leaders, I think the market itself goes beyond knowledge workers and developers. Agents, robots, drones etc will all use LLM or some world model.
I am rather more concerned about competition from CHINA. With how Huawei (2000 -> 2020) crushed every other telecom company and went from nobody to the most revered leader in 20 years, and with the depth of leadership in manufacturing and work culture, if China surpasses USA in AI, all US companies lose.
> 5% of every knowledge workers salary to go into tokens
In general, I don't think you can reason from the existence of potentially stranded investments back to revenue projections.
And when you frame this as percentage of salaries, that's a sneaky implication that this is only about reducing salaries and headcount, and not about adding capability, or doing things you couldn't do before, or making fewer mistakes, or capturing more revenue, or expanding margins, or competing more effectively.
That said, 5% of knowledge worker comp actually seems very low to me, given the capabilities, and considering the percentage of "knowledge work" that is absolute bullshit.
Two weeks ago I received an email from my HOA saying I'd been billed for a service I never asked for. So I replied to the email saying they'd made a mistake. There are now more than 30 messages in the thread, involving at least 8 "knowledge workers" at the property management company all passing the buck, and the problem is no closer to resolution.
An agent could wipe out all 8 of those bullshit jobs and solve my simple problem in five minutes instead of two weeks. Think of how many hundreds of thousands people are doing this nonsense just in the property management industry alone.
> They've got, ballpark, $5t to $10t to make back in the next 5 years, or the hardware buildouts will start getting written down.
I find it disappointing that a completely wrong statement like this ends up the top comment on HN.
It is wrong in both the math, the logic about public markets and understanding accounting.
> $5t to $10t to make back in the next 5 years
I don't know where this number comes from, but it has gone unchallenged.
OpenAI and Anthropic combined have raised around $100B. This is an investment so isn't something the have to "pay back" from earnings - instead investors expect to make that back from the share price being higher than what they paid for it.
> or the hardware buildouts will start getting written down.
The hardware buildouts get written down anyway!! That is a good thing for investors because as the value gets written down they can book a tax loss. ANd it turns out that generally agreed depreciation schedule for GPUs (used to be 3 years, now 5 years by places like Coreweave) is still too conservative since GPU rental prices for 5 year old chips are higher now than when they were new (!!)
All of this makes the rest of the math in the comment incorrect by at least an order of magnitude and under some scenarios possibly 2 orders of magnitude!
One factor to consider , the base will not remain the same over the next 5 yearts.
Every generation of developer tooling that increase of absolute code throughput creates a new class of developers (and users).
Always been the case since first compilers, through eras of frameworks to today, and the skill level needed to be one has dropped. In mid/late 80s only Master / Doctorate level Comp Sci professional could write any applications. It dropped to undergrad and just Information Technology engineers and comp sci theory became mostly optional and dropped further to any college level educated with some training and has been trending below with no/low code tools like retool pre 2022, that was before agent codegen services such as v0/replit and so on.
The next generation developers will not produce applications and architecture as previous generations did, just as we most of us here don't produce the level of quality that pg did when building this platform[1] , but as long as the user can find value it doesn't matter as countless enterprise applications of middling quality already prove today.
All this to say the 200M/30M numbers will not remain the same is the thesis for these businesses, will it change by large enough at a fast enough pace to justify the capex, I don't think so either. However web 1 then 2.0 , saas and mobile revolutions were pretty quick with new class of users and developers so not completely unrealistic .
[1] While HN is a heavy outlier with its custom lang lisp implementation, there are any number of examples from previous eras that are more moderate in choices but written with solid architecture with skill levels would be hard to find in today's generation founders.
Seems roughly right, that does seem to be about the boost in the most well-suited cases where you essentially know exactly how to solve the problem, the problem won't change much, and it's truly a matter of just churning out the implementation.
In that case precisely prompting, doing the review & nudge loop, can be a pretty nice (nice, still not game changing) speed boost over literally typing out the code to match the design in your head.
The less optimistic view though is that most things you build aren't like that. Even if they seem like it first. These things get booked as a nice speed boost, but you'll only find out much later they weren't.
A confounding factor is that it seems like many people not in the detail of building software do seem to think of most to all things are like that, even before AI assisted coding. Not much need to say more - see the entire history of the 'agile' movement for evidence of this.
And because most things aren't like that, I actually struggle to see fundamentally how more than 20-40% will ever be achieved (short of the ever-present deus ex machina of AGI argument), simply because the generation is already really good for these types of things. So since things like this aren't going to increase in overall proportion of things to be done, I don't see where the overall extra gains come from by models improving at this point.
Also hardware will be obsolete or dead in 5 years, and warrantys are 3 years from Nvidia. Ask crypto miners how these kind of hardware economics work. Numbers have to keep going up all around. Its a fundamentally broken business model unless prices increase 10x
consider cloud spending vs on-prem before the great cloud migrations. people are spending a lot more for cloud services now.
I hear conflicting things about finances, some have a different opinion, that it won't be written down so long as more funding comes in and revenue keeps increasing. it isn't like how you take mortgage or business loan, it isn't even a loan it's an investment funded by loans. So long as the investment is still promising, what are they going to do? destroy its value by calling in trillion dollar loans?
they need to make 5t-10t back, but not necessarily through selling tokens. as we can see, the frontier labs are making vertically integrated products. their revenue is no longer strictly tied to inference.
imo if your developers arent at least 2x as productive, then something is being done wrong on the employees part and/or the organization's. cli tools are ridiculously powerful provided you were an actual developer before using AI.
Maybe it's just me being (trigger warning from me providing an honest self assessment) very intelligent + a generalist, but i went from only full stack webdev and .NET to being able to implement an end-to-end LLM training pipeline (data curation, tokenizer, pretrain, sft, DPO - using ~$100 in cloud compute to train a class-competitive 1B STEM model)...and a full economic financial modeling and quant analysis application that pulls up to date economic, economic, news, stock data from the entire world and uses Dagster to orchestrate tech ical indicators and fundamentals and signals... and i did these things for learning and for fun. i built my own sublime text and obsidian replacement. i built my own reddit/twitter/hackernews/substack/news aggregator. i built countless other useful tools and utilities for me personally and for work I build more that empowers multiple departments.
Ive built 2 browser games, one already released to great reviews and 100k+ hours played. Ive built a tool on top of claude code that does ~60% of my job. Ive run data analysis on company financials for forecasting that have been refined and are producing very accurate predictions. Ive built competitive analysis tools and trackers.
All of this in 3 years. The projects are all clean, documented, with great code practices and modularity. A purist would surely consider some of the code slop. But it all works completely and fills real needs.
This is a huge shift. Anyone not realizing it yet is just simply behind the curve. I would not have accomplished 1/10 of this without AI coding. I went from copying code into and out of browser chats for 2 years before getting on the CLI train, and it is absolutely ridiculous the ROI you get from subscriptions to Claude or Codex.
Given what costs are and availability of parts, that 5 year write down is not in practice going to be the case. Maybe tax wise perhaps but especially for big fancy expensive multi million dollar 100-500kW racks these things are going to stick around for a while, I think.
Depreciation starts on day 1 and most likely they IMHO dont have 5 years. They dodged the deepseek bullet but who knows what is out there that will make all of this investment essentially worthless?
At some point, if we reach stability on the models, we'll start getting silicon optimized for individual models. They are optimizing for time to market, not efficiency right now. I don't know how much it will move the needle on the cost math, but at this scale any improvement has a crazy multiplier.
Also, with announcements of replacing developers with AI and consequent job losses, who is going to use the tokens? AI using its own tokens to produce code?
Your severely underestimating the idea that people are just not going to use developers for certain things in the future
For example I don’t anticipate somebody making a living off of making website ever again
Somebody with absolutely no technical experience who needs a website for their business can now make one with almost no money whatsoever.
That’s good enough for their business. and the code can be totally shit and it does not matter because it’s meeting their business objectives. I am seeing this in the wild and I’m paying money to companies that have these types of websites and because it doesn’t matter I don’t need for the website to work perfectly on all my devices all I need to be able to do is pay them through the website which is what they need me to do and our transaction is done.
Don’t forget ultimately the people who pay technologists right now are primarily advertisers
work on hard problems is going to continue to be some tiny fraction percentage of the software engineering discipline
just expect a total bloodbath because the goal isn’t developer productivity the goal is that “I don’t need to pay somebody $200,000 a year to build a website authoring tool like WordPress.”
Not to mention the competition: chinese open-weight models and open-source harnesses. Qwen3.6-(27B and 35B) have proven to be worthy and capable of running locally. I am confident more SMEs would look into this as a solution given the ballooning costs of API usage. You get a decent setup with an RTX 6000 Pro.
"5% of every knowledge workers salary to go into tokens. 20% if you're a developer"
Not unreasonable. I'm a hardware developer, and my employer spends ~10% of my salary on software tools. Add hardware tools and their maintenance and it's more like 30%.
> They've got, ballpark, $5t to $10t to make back in the next 5 years, or the hardware buildouts will start getting written down.
Depreciation and write-offs are about accounting models. Hardware will still be running after five years and still be making money. They may not be as efficient as the new hardware, but they will still be making real money even though they are valued at $0 in the books.
I don't think the unit economics are too terrible. Expensive, but not impossible.
200m knowledge workers in US and EU. Total salary around $15T/year.
$1T/year in token spending is about $5k/year per person. A big number, but not totally mad. That's the low end for office space per person for example. Probably close to the existing SaaS spend per person for a lot of roles.
We are still early in the deployment cycle for these tools so I would expect them to get better and also cheaper too.
It's worth noting that if each developer is 20% more productive with AI (let's take that as a premise and not dispute it), then it makes sense to go even further and reduce human headcount by more since the communication overhead of having 25% fewer developers is in and of itself a force multiplier.
tldr; 10 developers with 20% more 'productivity' can be replaced by 7.5 ideal developers and more like 6 or 7 developers due to the benefits of simply requiring less organizational communication.
I still think the ideal team size is unchanged however and that's 7-10 people. Note that teams aren't necessarily the same as direct reports. A CEO for instance has a certain number of reports and a leadership 'team' but they're not a team in the traditional sense since they are more about making good decisions and collaborating on specific things but mostly about leading their own orgs that have vastly different skillsets from eachother.
Plus, at some point there are less tokens because local models being optimised and can work with protected information. For enterprises that want an AI with a knowledge base of internal documents, this becomes more interesting by the day.
We're going to reach a point where these companies stop asking for money and start mandating it. They've got a vice grip around the nuts of many governments and loads of companies have gone all in on investing in these slop heaps.
At some point, companies are going to start removing basic features. Governments and essential services are going to make people go through chatbots to get basic service. They're going to require AI to validate stuff that's already automated and working fine. Google search? That'll be all AI (and I guess they're already rolling it out). Dentist appointment? Going to need to do it through some AI app that requires an account and tokens "for a better patient experience". Verifying your ID when buying alcohol? Going to need AI to scan it and take 90 seconds to determine whether it's real. And it'll say you're an 7 year old farm worker in rural Botswana, so you can't get alcohol. And they're going to milk money at every level of this.
I hear this and I keep wondering what I’m missing. My productivity has shot through the roof over the last year as a result of having these tools. I’ve been able to unlock projects that I’ve wanted to do for years.
I don't think the maths works like that. They have raised ~$200bn so far and need to make that back. Saying they need to make $5 to $10tn isn't really real. They might need that to meet some extravagant Altman projections but not to justify what they have actually spent.
Yeah, claiming “product-market fit” on coding assistants for this multi-trillion dollar capital expenditure seems premature. Anthropic will post one and only one quarter of “operating profit” (aka losses after taxes and debt obligations) on the back of free-for-all spending by enterprise and engineer tokenmaxxing, neither of which will last. The investment was commensurate to a world-eating AGI, and if all that comes out of it is coding agents and slightly better enterprise software, I don’t think that makes up for the money spent.
> ... against the actual work their company cares about doing. [...] stuff that matters
This is a key point. Some engineers are having fun doing e.g. greenfield stuff with AI that they never would have had time for otherwise. Whether the company cares about that is another question.
It's related to Goodhart’s Law. If AI token usage is a target, then you're going to get a lot of token usage, but it's not likely to correlate well to improved business outcomes.
> That's a _huge_ shift. Most people I know cite +20%-40% velocity with these tools, against the actual work their company cares about doing. +20% speed for +20% spend isn't going to motivate a trillion dollars a year in spending.
20-40% sounds about right for me, today. Maybe 40-60% on a good day. But a lot of the reason it's not higher comes from harness gaps and org processes that haven't caught up.
Doesn't matter, it will be pushed and forced down people's throats because someone invisible thinks it's the new way forward. And for that you need more money for NVDA and the like, and now people have to be made cultists in order to let the money flow in.
Same happened and happens in gaming. The gamers "invested" into NVDA by eating all the bullshit about ray tracing and the like. And they kept buying all the crappy 1000$+ gpus because youtubers said that the extra 1000 dollars worth those +15 fps plus the ray tracing....
So how do openai and anthropic plan to keep customers when GLM-5.1 is just as good and open source and a lot cheaper?
I don't see the business model working. My closest friend actually does automation software for large companies.
He does not use Claude or openai at all. He primarily uses gpt 120b on cerebras and glm-5.1 for heavy thinking work.
And some other small models for various tasks. All open source.
And these systems are extremely useful for the businesses and are able to run fully automated pipelines that are very stable and fast.
We discuss this a lot, and we both think any business doing heavy agentic work on Claude and openai just aren't aware of exactly how good and cheap open source has gotten on the last year.
So... once the legacy businesses and developers catch up, won't Claude and openai be unable to recoup their costs?
Don't you need to spend 5-10 thousand USD to run these models that are "as good" as frontier models from 6-12 months ago? I haven't seen a convincing breakdown for ROI of running your own coding models. Especially against a $20 or even $200 plan
Do you have a good source to refer to, to map out migration from Claude code to a cheap setup using small open source models like you’re describing? I’d certainly like to experience how good they’ve gotten.
Download OpenCode and try OpenCode Go for a month. It's $5 USD for the first month. This will give you a taste of what the open model experience is like.
If you want to try the smaller models, just use them on an API service first. There is no model you can run locally (for less than $100k) that compares to GLM 5.1 though.
I have 26 years experience. I code using GLM-5.1. Fron time to time I switch to Codex / Claude, and honestly I don't understand why people uses Claude or codex. With the right prompting, GLM is awesome.
If nothing else this blog did give me the idea that I should split my $200 claude max plan into two $100 CC max and $100 codex plan, esp because Claude is now offering 1.5x weekly limits so its the 5x usage is now more like 7.5x usage.
“Tokens” don’t have an intrisic cost or value. Saying that I used $2,180.16 worth of tokens is like relying on the salesperson to convince me I’m getting a billion dollars worth of pots and pans for $19.99.
I think it’s funny how we are throwing critical thinking out the window when it comes to evaluating biased sources of info.
i am pretty sure these services know what it truly costs them to serve you tokens, maybe not in realtime but at least periodically.
however, what they charge us is a constant exercise in price discovery. i agree with this sentiment in the sense that we don't have a stable sense of the cost. all of these comparisons are good for the moment, or at most the near future.
i believe that even the "all you can eat" approach with the max plans, regardless of their crazy pricing, is not sustainable only with the power users. if most of us gets this kind of value through our plans, surely it does not incentivise the service providers to continue pushing it. maybe they can regardless just to gain market share, but not forever.
>Somehow this fragment turned into headlines like Uber’s COO says it’s getting harder to justify the money spent on AI tokenmaxxing, because the market for stories about AI failures remains enormous.
I notice this all over the place. Many people hate AI and want it to fail, and they're willing to invent misinformation if it supports that idea.
I think the reasons for them going with API pricing will become abundantly clear when the S-1s become available. If they don't have a story covering how they can get revenue closer to expenses, then they're relying on the market to believe the pixie dust version of their profitability story, which I think people increasingly don't.
The costs are exorbitant and most software is not produced by companies with such a huge moat. Anthropic made a profit through their recent bait amd switch pricing. There is zero useful insights online to indicate whether this might die due to commoditisation with good enough open models or fail the race to get more people subsidising unsustainable growth with other people’s money. Who knows? In any case they dont seem to be able to drop usage costs so the business model seems based on wishes
How is the lack of bad news declaring a victory for AI? I am yet to see any company concretely publish analysis about the ROI from AI. Most companies as far as I know are still treating AI investment as sunk cost with no expectation of returns at the moment. We could very well see a world where companies heavily scale back investment.
Does this analysis factor in potential caching of tokens on the server side? It seems that if they organize things well (as a model provider), they can save quite a lot on that. Looking at my Cursor statistics makes it clear that the token calculations are not at all trivial.
Who's to say those enterprises won't churn after XYZ comes out with a decent enough model that costs 10x less to use?
There's a whole bag of clever tricks you can play to juice short term results leading to an IPO that may not work longer term.
I'll believe they've found product-market fit when they have a product. Right now they're selling the infrastructure, in a highly subsidized and undifferentiated way (at least over a sufficient long period of time of, say, a couple of years).
Companies are kool-aid drinking now due to hype, but given how much they're spending, if they don't see REAL, BIG wins from it soon, they're going to scale it back quickly and switch to Chinese models. Claude isn't worth the API cost for a lot of development work, and once companies have had time to collect and crunch data they'll see this.
216 comments
[ 3.2 ms ] story [ 87.1 ms ] threadThe impact of AI in other fields seems to be muted.
However the valuations are still far far away from actual sanity
This means we're going to need $1t+ per year in spending, per year, on tokens. 200m knowledge workers in the world, 30m developers. We're talking about a world where you need 5% of every knowledge workers salary to go into tokens. 20% if you're a developer.
That's a _huge_ shift. Most people I know cite +20%-40% velocity with these tools, against the actual work their company cares about doing. +20% speed for +20% spend isn't going to motivate a trillion dollars a year in spending.
We're not there yet. This is still the upswing of the hype cycle, and unless we figure out how to make developers 2x, 5x, 10x as productive on stuff that matters, this isn't going to play out well.
Your scope is too narrow. The companies target more than white-collar jobs. And $1t is around 0.5% of the world economy.
So besides the insane hardware buildouts you're correctly mentioning, I don't understand how anyone that invests in these companies is supposed to make their money back in any sort of reasonable timeframe?
The cynical part of me is looking at what happened to the NASDAQ rules recently where essentially index funds are going to be forced to buy SpaceX shares much earlier than they previously would have (ie, before the price has a chance to reach it's real valuation). Which, um, I'm guessing these stocks are going to drop pretty hard when people start looking at the financials of these companies.
My suspicion is that the point of these IPOs is essentially to dump the bill on the unwilling public by forcing various institutions to buy it (ie, your 401k or pension is buying this shit), and maybe their investors can squeeze some money out of this before the stocks reach an equilibrium that's probably like 1/10th of what they're "valued" at.
2. The companies themselves buying tokens for operations to make the work more efficent. e.g. Salesforce agent or Microsoft Office agent or random saas inventory agent. (and if you say those will go away (which I don't believe), it's even more bullish. The tokens just go to someone vibe coding XYZ, which is EVEN MORE than if you were to buy saas because it's SaaS product x Companies that built it instead of just one)
3. The companies SELLING tokens. This is also new markets like schools and small business (e.g. the local gas station buying an inventory tool)
4. The consumers "buying" (I put in quotes because it can be subsidised but the company) through chatgpt, strava, instagram/netflix recommendation, etc.
Local models still take compute, and while it may be cheaper, it is the same argument of on prem vs cloud. No one operates on prem unless you HAVE to for regulatory. Margins will come down and you just spin up a GCP/OpenAI/Anthropic agent.
It may be "cheaper" but rationally its better to pay someone to manage it. Thats why Hetzner only had $367M in revneue (a lot but tiny compared to managed services)
Anthropic Max: $100/month
OpenAI Pro: $100/month
Total paid: $200/month
API equivalent usage: $2,180.16 in 30 days
So paid only 9.17% of API-priced value a 90.83% discount, or about $10.90 of API priced usage for every $1 paid...
That proves heavy usage but not sustainable unit economics.
Anthropic reported numbers point the same way:
Q2 revenue: $10.9B
Adjusted operating profit: $559M
Margin: 5.1%
SpaceX compute: $1.25B/month = $3.75B/quarter
So one compute supplier alone equals 34.4% of quarterly revenue and 6.7x quarterly adjusted operating profit.
Its difficult for the blogger to understand something when its incentives depend on not understanding it...
(I'm not trying to imply that LLMs can replace software engineers, it's just an interesting comparison. If nothing else, I suspect that if the cost of development goes down, demand for custom software will go up.)
https://claude.ai/share/8a3de813-677e-4a75-9b7f-1785495c2569
Honestly doesn't seem great for the AI companies.
If it works. And I’m not sure who is going to buy the stuff the machines produce, but shrug. Presumably some bots click ads for NFT’s that other bots generate.
What I do not understand is: large sectors of the economy all simultaneously taking this punt, with the necessary productivity boost, as you say, far more like: 2x, 5x, 10x
I'm increasingly realizing this math is wrong, because LLM use is really sticky.
If Anthropic 100x'd prices tomorrow for their best model, so some companies offered 50% salary to keep 100% of your AI usage:
a) There are programmers who would take this deal. They've gotten to the point of doing what feels like even less than 50% of the work, developers were already pretty well paid, so they'll take it.
b) There are companies that'd offer this deal. Even if the only people who are taking this deal are not the best engineers, and the AI output is not the greatest, I think the last 6 or so years have seen a lot of companies realize capitalism is not as competitive as it seems.
They're not worried about putting out a worse product because... frankly, what else are you going to do? CF lay a bunch of people off, support gets awful: well you're probably not building a new Cloudflare in the next few years.
In the meantime the AI will get incrementally better, their market share will grow, and you won't be able to compete without taking the same faustian bargain.
-
Maybe I was just naive but it's making me realize how much we take for granted in the world. Both the quality and relative value of things don't have to go up over time. Quality can go down while prices go up, and nothing will really stop it. Competition should stop it, but competition is really slow and can be interfered with. And as prices go up competition gets really hard.
Just realized something: if one worries about losing jobs to AI, token's high unit cost is good news. To say the least, high cost would delay the displacement, if any, right?
In the meantime, someone shared the below on X. I guess the moral of the story is that "good enough" does not just displace software engineers, but also models.
I am rather more concerned about competition from CHINA. With how Huawei (2000 -> 2020) crushed every other telecom company and went from nobody to the most revered leader in 20 years, and with the depth of leadership in manufacturing and work culture, if China surpasses USA in AI, all US companies lose.
In general, I don't think you can reason from the existence of potentially stranded investments back to revenue projections.
And when you frame this as percentage of salaries, that's a sneaky implication that this is only about reducing salaries and headcount, and not about adding capability, or doing things you couldn't do before, or making fewer mistakes, or capturing more revenue, or expanding margins, or competing more effectively.
That said, 5% of knowledge worker comp actually seems very low to me, given the capabilities, and considering the percentage of "knowledge work" that is absolute bullshit.
Two weeks ago I received an email from my HOA saying I'd been billed for a service I never asked for. So I replied to the email saying they'd made a mistake. There are now more than 30 messages in the thread, involving at least 8 "knowledge workers" at the property management company all passing the buck, and the problem is no closer to resolution.
An agent could wipe out all 8 of those bullshit jobs and solve my simple problem in five minutes instead of two weeks. Think of how many hundreds of thousands people are doing this nonsense just in the property management industry alone.
5% is nothing.
We all have our own observations and mine don’t significantly diverge. But that’s bottom up. At this point shouldn’t we be seeing it top down?
If we are beyond potential and into significant productivity gains, why isn’t that showing up for the customers?
Why didn’t delta airlines get significantly more operationally efficient in the last 3 months due to the introduction of better software?
This is a genuine question, I am seeing a disconnect.
I find it disappointing that a completely wrong statement like this ends up the top comment on HN.
It is wrong in both the math, the logic about public markets and understanding accounting.
> $5t to $10t to make back in the next 5 years
I don't know where this number comes from, but it has gone unchallenged.
OpenAI and Anthropic combined have raised around $100B. This is an investment so isn't something the have to "pay back" from earnings - instead investors expect to make that back from the share price being higher than what they paid for it.
> or the hardware buildouts will start getting written down.
The hardware buildouts get written down anyway!! That is a good thing for investors because as the value gets written down they can book a tax loss. ANd it turns out that generally agreed depreciation schedule for GPUs (used to be 3 years, now 5 years by places like Coreweave) is still too conservative since GPU rental prices for 5 year old chips are higher now than when they were new (!!)
All of this makes the rest of the math in the comment incorrect by at least an order of magnitude and under some scenarios possibly 2 orders of magnitude!
That's not a small error!
Every generation of developer tooling that increase of absolute code throughput creates a new class of developers (and users).
Always been the case since first compilers, through eras of frameworks to today, and the skill level needed to be one has dropped. In mid/late 80s only Master / Doctorate level Comp Sci professional could write any applications. It dropped to undergrad and just Information Technology engineers and comp sci theory became mostly optional and dropped further to any college level educated with some training and has been trending below with no/low code tools like retool pre 2022, that was before agent codegen services such as v0/replit and so on.
The next generation developers will not produce applications and architecture as previous generations did, just as we most of us here don't produce the level of quality that pg did when building this platform[1] , but as long as the user can find value it doesn't matter as countless enterprise applications of middling quality already prove today.
All this to say the 200M/30M numbers will not remain the same is the thesis for these businesses, will it change by large enough at a fast enough pace to justify the capex, I don't think so either. However web 1 then 2.0 , saas and mobile revolutions were pretty quick with new class of users and developers so not completely unrealistic .
[1] While HN is a heavy outlier with its custom lang lisp implementation, there are any number of examples from previous eras that are more moderate in choices but written with solid architecture with skill levels would be hard to find in today's generation founders.
Seems roughly right, that does seem to be about the boost in the most well-suited cases where you essentially know exactly how to solve the problem, the problem won't change much, and it's truly a matter of just churning out the implementation.
In that case precisely prompting, doing the review & nudge loop, can be a pretty nice (nice, still not game changing) speed boost over literally typing out the code to match the design in your head.
The less optimistic view though is that most things you build aren't like that. Even if they seem like it first. These things get booked as a nice speed boost, but you'll only find out much later they weren't.
A confounding factor is that it seems like many people not in the detail of building software do seem to think of most to all things are like that, even before AI assisted coding. Not much need to say more - see the entire history of the 'agile' movement for evidence of this.
And because most things aren't like that, I actually struggle to see fundamentally how more than 20-40% will ever be achieved (short of the ever-present deus ex machina of AGI argument), simply because the generation is already really good for these types of things. So since things like this aren't going to increase in overall proportion of things to be done, I don't see where the overall extra gains come from by models improving at this point.
I hear conflicting things about finances, some have a different opinion, that it won't be written down so long as more funding comes in and revenue keeps increasing. it isn't like how you take mortgage or business loan, it isn't even a loan it's an investment funded by loans. So long as the investment is still promising, what are they going to do? destroy its value by calling in trillion dollar loans?
+ LLM-powered robotics, autonomous, IoT, smart manufacturing
+ LLM-powered biotech, healthcare, genetic engineering, medicine
+ Recursive model improvement
+ Multiply the # of devs (software truly eats world)
+ Exponential increases in model performance / cost decrease (algorithms, power, infra, chips, architectures, etc.)
What are you basing this on? For reference, Anthropic raised ~$70 billion in total and OpenAI ~$190 billion. Why do they need to make 20-40x that?
1 in 6 knowledge worker is a developer ! Surely that’s too high thou explains the job market
Maybe it's just me being (trigger warning from me providing an honest self assessment) very intelligent + a generalist, but i went from only full stack webdev and .NET to being able to implement an end-to-end LLM training pipeline (data curation, tokenizer, pretrain, sft, DPO - using ~$100 in cloud compute to train a class-competitive 1B STEM model)...and a full economic financial modeling and quant analysis application that pulls up to date economic, economic, news, stock data from the entire world and uses Dagster to orchestrate tech ical indicators and fundamentals and signals... and i did these things for learning and for fun. i built my own sublime text and obsidian replacement. i built my own reddit/twitter/hackernews/substack/news aggregator. i built countless other useful tools and utilities for me personally and for work I build more that empowers multiple departments.
Ive built 2 browser games, one already released to great reviews and 100k+ hours played. Ive built a tool on top of claude code that does ~60% of my job. Ive run data analysis on company financials for forecasting that have been refined and are producing very accurate predictions. Ive built competitive analysis tools and trackers.
All of this in 3 years. The projects are all clean, documented, with great code practices and modularity. A purist would surely consider some of the code slop. But it all works completely and fills real needs.
This is a huge shift. Anyone not realizing it yet is just simply behind the curve. I would not have accomplished 1/10 of this without AI coding. I went from copying code into and out of browser chats for 2 years before getting on the CLI train, and it is absolutely ridiculous the ROI you get from subscriptions to Claude or Codex.
For example I don’t anticipate somebody making a living off of making website ever again
Somebody with absolutely no technical experience who needs a website for their business can now make one with almost no money whatsoever.
That’s good enough for their business. and the code can be totally shit and it does not matter because it’s meeting their business objectives. I am seeing this in the wild and I’m paying money to companies that have these types of websites and because it doesn’t matter I don’t need for the website to work perfectly on all my devices all I need to be able to do is pay them through the website which is what they need me to do and our transaction is done.
Don’t forget ultimately the people who pay technologists right now are primarily advertisers
work on hard problems is going to continue to be some tiny fraction percentage of the software engineering discipline
just expect a total bloodbath because the goal isn’t developer productivity the goal is that “I don’t need to pay somebody $200,000 a year to build a website authoring tool like WordPress.”
Also, according to https://isaiprofitable.com/ total industry spend is also an order of magniture less than what your assumption is.
So in your model 0.2% of knowledge worker salaries instead of 5%, IF all the AI players win the investing gamble and do infact make back their money.
When you break it down like that it seems reasonable. I'm spending about $5k/mo on tokens, seems more and more normal.
Not unreasonable. I'm a hardware developer, and my employer spends ~10% of my salary on software tools. Add hardware tools and their maintenance and it's more like 30%.
Depreciation and write-offs are about accounting models. Hardware will still be running after five years and still be making money. They may not be as efficient as the new hardware, but they will still be making real money even though they are valued at $0 in the books.
OpenAI's spending commitment is in the ~1T range for the next 5 years, and Anthropic is ~300B.
If they continue to show strong growth, they likely need to be at 100-300B in revenue/yr to support their yearly payments + financing, not 1T.
200m knowledge workers in US and EU. Total salary around $15T/year.
$1T/year in token spending is about $5k/year per person. A big number, but not totally mad. That's the low end for office space per person for example. Probably close to the existing SaaS spend per person for a lot of roles.
We are still early in the deployment cycle for these tools so I would expect them to get better and also cheaper too.
tldr; 10 developers with 20% more 'productivity' can be replaced by 7.5 ideal developers and more like 6 or 7 developers due to the benefits of simply requiring less organizational communication.
I still think the ideal team size is unchanged however and that's 7-10 people. Note that teams aren't necessarily the same as direct reports. A CEO for instance has a certain number of reports and a leadership 'team' but they're not a team in the traditional sense since they are more about making good decisions and collaborating on specific things but mostly about leading their own orgs that have vastly different skillsets from eachother.
At some point, companies are going to start removing basic features. Governments and essential services are going to make people go through chatbots to get basic service. They're going to require AI to validate stuff that's already automated and working fine. Google search? That'll be all AI (and I guess they're already rolling it out). Dentist appointment? Going to need to do it through some AI app that requires an account and tokens "for a better patient experience". Verifying your ID when buying alcohol? Going to need AI to scan it and take 90 seconds to determine whether it's real. And it'll say you're an 7 year old farm worker in rural Botswana, so you can't get alcohol. And they're going to milk money at every level of this.
This is a key point. Some engineers are having fun doing e.g. greenfield stuff with AI that they never would have had time for otherwise. Whether the company cares about that is another question.
It's related to Goodhart’s Law. If AI token usage is a target, then you're going to get a lot of token usage, but it's not likely to correlate well to improved business outcomes.
20-40% sounds about right for me, today. Maybe 40-60% on a good day. But a lot of the reason it's not higher comes from harness gaps and org processes that haven't caught up.
All of that will get fixed with time.
Same happened and happens in gaming. The gamers "invested" into NVDA by eating all the bullshit about ray tracing and the like. And they kept buying all the crappy 1000$+ gpus because youtubers said that the extra 1000 dollars worth those +15 fps plus the ray tracing....
I don't see the business model working. My closest friend actually does automation software for large companies.
He does not use Claude or openai at all. He primarily uses gpt 120b on cerebras and glm-5.1 for heavy thinking work. And some other small models for various tasks. All open source.
And these systems are extremely useful for the businesses and are able to run fully automated pipelines that are very stable and fast.
We discuss this a lot, and we both think any business doing heavy agentic work on Claude and openai just aren't aware of exactly how good and cheap open source has gotten on the last year.
So... once the legacy businesses and developers catch up, won't Claude and openai be unable to recoup their costs?
If you want to try the smaller models, just use them on an API service first. There is no model you can run locally (for less than $100k) that compares to GLM 5.1 though.
“Tokens” don’t have an intrisic cost or value. Saying that I used $2,180.16 worth of tokens is like relying on the salesperson to convince me I’m getting a billion dollars worth of pots and pans for $19.99.
I think it’s funny how we are throwing critical thinking out the window when it comes to evaluating biased sources of info.
i am pretty sure these services know what it truly costs them to serve you tokens, maybe not in realtime but at least periodically.
however, what they charge us is a constant exercise in price discovery. i agree with this sentiment in the sense that we don't have a stable sense of the cost. all of these comparisons are good for the moment, or at most the near future.
i believe that even the "all you can eat" approach with the max plans, regardless of their crazy pricing, is not sustainable only with the power users. if most of us gets this kind of value through our plans, surely it does not incentivise the service providers to continue pushing it. maybe they can regardless just to gain market share, but not forever.
A single 3D CAD license pack for the guys in our R&D group costs multiple thousands of dollars per seat, per month.
It's about time software seats get some love too.
I notice this all over the place. Many people hate AI and want it to fail, and they're willing to invent misinformation if it supports that idea.
Is that quarter same as any other quarter in terms of infrastructure costs (e.g. are there any temporary discounts happening coincidentally)?
There's a whole bag of clever tricks you can play to juice short term results leading to an IPO that may not work longer term.
I'll believe they've found product-market fit when they have a product. Right now they're selling the infrastructure, in a highly subsidized and undifferentiated way (at least over a sufficient long period of time of, say, a couple of years).