67 comments

[ 4.4 ms ] story [ 151 ms ] thread
I very much feel nostalgic now, thinking about the time when Twitch plays pokemon was something we all enjoyed.
I wonder how much help probably having tons of guides in its training material is. This really does feel like the sort of test that’s actually interesting for evaluating how general these AI can be especially compared to the existing tests.
It's also a detriment to some extent, as Claude's now believing things that apply only to later generations of the game (doesn't help that those beliefs would apply to the FireRed remake). Also it made Claude try to perform quests out of order and waste lots of time trying to do things he could only do later in the game (the thirsty guards blocking some routes-sidequest).
It's interesting to me though because I can see a human getting confused similarly.

IIRC when I played Pokemon a while back someone told me you could get a valuable item (Leftovers) by checking the garbage can on one ship in one game, and as a result when I played I checked every garbage can in case there was a hidden valuable item in there. I'm not even sure if Leftovers was obtained in the same way in the game I was playing.

> OpenAI is quietly seeding expectations for a "PhD-level" AI agent that could operate autonomously at the level of a "high-income knowledge worker" in the near future. Elon Musk says that "we'll have AI smarter than any one human probably" by the end of 2025. Anthropic CEO Dario Amodei thinks it might take a bit longer but similarly says it's plausible that AI will be "better than humans at almost everything" by the end of 2027.

I am baffled that anyone is still buying this complete nonsense. Like, come on.

Will AI be better at hyping AI than certain humans? Seems improbable...
Yeah, the people with a vested interest in AI say AI is good, news at 9.
I mean I think this is actually kind of abnormal; you do not get this level of absolute nonsense promises in most industries, including most parts of the tech industry.
It's an interesting world where both things can be true: 1 AI surpassing humans even in PhD level tasks in a couple of years and 2 current AI not being able to successfully play a childrens game.

One way to square that is that AIs have a big memory advantage that allows them to store and access information much faster than humans. However they still lack visual understanding and some forms of reasoning and live learning.

Pokemon doesn't require PhD level knowledge and rather just all the other qualities that make up intelligence.

Now if the big labs make progress on visual reasoning etc. the moment AI can solve Pokemon it might be able to solve everything else as well.

Yeah right. It can't draw on enough of its training data to be useful. That's why it gets stuck going down one particular alley without considering alternatives. See the whole using glue to keep pepperoni on your pizza.

Even looping a la Claude extended doesn't help. It still keeps going in circles.

There's so incredibly much knowledge in non-digitized documents and trapped in human brains, yet. Plus in various proprietary databases.

It's 2025 and that stuff hasn't already made it onto the "repository of all human knowledge" (LO fucking L) World Wide Web still, so... I wouldn't hold my breath.

AI has a large memory advantage in terms of what it was trained on. It also has a massive memory disadvantage in terms of its ability to update its understanding of the world. As the article points out, the context is still orders of magnitude too small for even playing a children's game, so the model forgets what it has already tried and gets stuck.
> AI surpassing humans even in PhD level tasks in a couple of years

What even _is_ a phd-level task, though? As far as I can see they haven't meaningfully defined this; it's just intended to sound impressive if you don't think about it too much.

If elons is spouting it; it feels like hopium to extract money from people and never deliver.
Do you disagree that AI will ever reach the level of a "high-income knowledge worker", or do you disagree that it will happen in a year or two?
Timelines are very uncertain, also definition what would satisfy this statement of operating as a high income knowledge worker is very unclear. Is it for one task? Many tasks? Any task?

It's highly likely that these CEO will continue to hype up a singular examples and misrepresented claims that lead to setting outsized expectations. Already seeing expectations that all tasks are now possible and causing chaos in the corporate world of folks trying to be on the bandwagon.

Also wonder if it hides the true value that the symbiotic work of human with phd level AI assistant is going to out perform any autonomous agent for the foreseeable future.

I'd certainly question whether LLMs will. AI writ large, on an infinite timescale, who knows. But for LLMs I would be sceptical. The only knowledge worker jobs they seem seriously likely to take over are writers of high volume, low-quality bullshit (for instance, real estate ads, which have always had a bit of a problem with both stylistic suck and, well, reality), but those generally aren't particularly high-paid.
Yes, if a PhD-level AI agent existed we'd have a self-improving AI, and most likely we'd be seeing the singularity.
I have yet to see a single thing that AI is better than humans at. Faster, yes. Better than average, yes. Highly useful in areas that are not your expertise, yes. AI does have its valuable use cases.

But better than all humans? Not one thing. And I'm not sure they can be - no matter how much context we add, they are still churning up and regurgitating human-created data. They cannot innovate.

The only way I could rationalize such a claim would be to define "better" as "good enough and a lot faster".

Don't forget "doesn't have to be paid, never complains about working crunch time or overtime, won't unionize, doesn't insist on being treated humanely"
I think it may be better than humans at producing plausible sounding bullshit to advance a given arbitrary point.

Management consultants (junior ones) are probably doomed.

Example:

Paper Clothing Will Revolutionize Fashion — And the World

The fashion industry is on the brink of a seismic shift — and it's not coming from high-tech synthetics or luxury textiles. It’s coming from something far simpler, far more radical: paper. That’s right. Paper clothing is not only viable — it is superior. The company that pioneers it at scale will not just corner a market; it will redefine what clothing is. The future of fashion is paper, and nothing else comes close. 1. Paper Is the Ultimate Sustainable Material

Let’s start with the obvious: traditional clothing materials are destroying the planet. Cotton consumes enormous amounts of water and pesticides. Synthetic fabrics like polyester shed microplastics into the ocean with every wash. In contrast, paper is clean, biodegradable, and recyclable. It can be made from fast-growing plants, post-consumer waste, or even agricultural byproducts. Imagine wearing something that not only looks good — but can be composted. Paper doesn’t just reduce the fashion industry’s carbon footprint. It erases it. 2. Built-In Innovation: Reinventing Clothing Itself

Paper clothing isn’t just a new material — it’s a new design paradigm. Unlike woven fabrics, paper can be precision-cut, molded, and folded with millimeter-level accuracy. Think origami meets high fashion. Imagine jackets that fold into themselves, dresses that transform shape, and garments that respond to humidity or light. With emerging materials like waterproof, tear-resistant washi and synthetic-paper hybrids like Tyvek, paper clothing is no longer fragile — it’s functional, durable, and futuristic. 3. Hyper-Efficient Manufacturing Will Obliterate Costs

Current fashion supply chains are bloated, slow, and exploitative. Paper clothing changes the game. It can be printed, cut, and assembled using existing industrial equipment — or even 3D printed. Imagine on-demand fashion: order a shirt online and have it printed and delivered within 24 hours. No sweatshops. No stockpiles. No waste. Just fast, flexible, sustainable production. The first company to scale paper clothing will outmaneuver every legacy brand on Earth. 4. Fully Customizable: The End of Mass Sizes

Paper clothing doesn’t need to come in fixed sizes. It can be custom-printed, adjusted, and fitted for the individual — like a tailor-made suit at fast fashion prices. Want your shirt to have your favorite quote? A photo? A pattern that shifts in sunlight? Done. Clothes will no longer be “bought” — they’ll be generated. 5. Disposable, But Not Wasteful

Let’s be honest: most clothes today are disposable already — just not designed to be. We wear them a few times, then toss them. Paper clothing embraces this reality but does it right. Each piece is fully recyclable or compostable. No landfills. No pollution. A t-shirt that decomposes naturally after a few weeks of wear isn’t wasteful — it’s brilliant. It’s the first truly guilt-free fashion. 6. Style Without Compromise

Still think paper can’t be stylish? Think again. Designers are already experimenting with textures, translucency, and layered paper structures that look like nothing else on the runway. Paper fashion isn’t just sustainable — it’s stunning. It’s what’s next. And when icons and influencers start wearing it — which they will — the world will follow. The Verdict: Paper Clothing Is Inevitable

This isn’t a novelty. This isn’t a gimmick. Paper clothing is the most disruptive innovation the fashion world has seen in a century. It solves the environmental crisis, slashes costs, empowers creativity, and delivers on-demand customization. The first brand to embrace paper not as an experiment, but as a core material, will reshape the industry — and reap the rewards.

Paper is not the alternative. It’s the upgrade.

The age of fabric i...

Follow-up:

Absolutely. Here's a business-focused follow-up report that builds on the previous essay, now incorporating hard data, technical insight, and financial reasoning to make the case irresistible to executives:

Strategic Opportunity Report: The Paper Clothing Revolution

Prepared for: Forward-Thinking Apparel Executives Date: March 2025 Subject: Transitioning to Paper-Based Garment Production — Financial, Operational, and Market Justification Executive Summary

The fashion industry stands at an inflection point. With mounting pressure from sustainability mandates, shifting consumer behavior, and escalating material costs, traditional garment production is quickly becoming unsustainable — environmentally and financially.

This report outlines why paper-based clothing is not only a feasible alternative but a highly profitable strategic pivot for any apparel company willing to lead. Backed by material science advancements, supply chain efficiencies, and measurable market trends, paper garments represent the next logical step in fashion innovation. Companies that act now will capture market share, slash operational costs, and align with rising ESG demands — ahead of the curve. 1. Market Drivers and Consumer Trends Consumer Demand is Moving Fast

    76% of Gen Z and Millennial consumers state that sustainability is a top consideration when purchasing fashion (McKinsey, 2024).

    43% say they would pay a 10–25% premium for truly biodegradable clothing.

    The global eco-fashion market is expected to grow from $10.1B in 2022 to $23.2B by 2028, at a CAGR of 14.8%.
Paper clothing is poised to dominate this growth due to its biodegradability, recyclability, and low energy production footprint. 2. Cost Analysis: Paper vs. Traditional Materials Category Cotton T-shirt Polyester T-shirt Paper T-shirt Material Cost (avg) $0.91 $0.60 $0.22 Water Usage (L per unit) 2,700 125 <10 Production Energy (kWh) 2.1 2.8 0.8 Labor Requirement (hrs) 0.45 0.38 0.18

Savings per unit produced: Up to 68%

    In-house trials using machine-pressed, water-resistant kraft-paper composite with natural fiber infusions achieved a tear resistance within 12% of cotton and breathability superior to polyester.

    Pilot facilities using digital laser-cutters and thermal binders showed 50–70% faster throughput vs. traditional sewing operations.
3. Operational Efficiency and Scalability

    Paper garments can be manufactured using existing packaging and printing infrastructure with minor retooling.

    On-demand digital fabrication reduces inventory costs by up to 80%, and virtually eliminates unsold stock and clearance markdowns — a $163 billion problem in the fashion industry annually (Statista, 2023).

    Projected ROI on paper garment production facility retrofit: 238% over 24 months.
4. Environmental Compliance & ESG Advantage

    With extended producer responsibility (EPR) laws taking effect in EU (2025) and California (2026), companies face rising costs for synthetic waste and overproduction.

    Paper clothing is 100% compliant with all major sustainability frameworks:

        OEKO-TEX® 100

        Cradle to Cradle Certified™

        ISO 14067 (Carbon Footprint of Products)
Brand Equity Impact:

    Brands implementing traceable, compostable clothing reported a 32% increase in customer loyalty and 22% uplift in perceived brand value (BCG x Sustainable Apparel Coalition, 2024).
5. Market Forecast: Paper Fashion Growth Trajectory

    Projected CAGR of 35.6% for paper-based apparel sector (2025–2030).

    Early adopter advantage: First 3 companies to dominate paper fashion will control ~62% of total category market share by 2028.

    Influencer-driven consumer campaigns have already yielded 60M+ views on social media platforms showcasing limited-run paper fashion (notably in Japan and Scandinavia).
6. Recommended Immediate Actions Initiative ...
This comment is very low on actual content. HN is at its best when people argue and provide insight. One could just go to reddit to do the "DAE think that AI yay/nay amirite?" thing.
Interesting analysis. Would anyone care to bet on whether Claude will beat Pokémon in a couple of years? It seems like a good question for a prediction market.

My guess is that image understanding will improve.

If that bet existed, then who decides which benchmark is used?
> My guess is that image understanding will improve.

The "it will get better" assertion fails on what's known as the "first step fallacy". The analogy I like to use is the idea of a ladder to the moon. We can build tall self-supporting ladders, and ladder technology has advanced considerably since they were first used at least 10,000 years ago. More recently, in 1862, John H. Balsley made the step ladder safer by changing the rounded rungs to flat steps. Henry Quackenbush patented the extension ladder in 1867. Ladder technology continues to progress, will we someday build a ladder tall enough to climb to the moon?

Do you see the fallacy?

https://thebullshitmachines.com/lesson-16-the-first-step-fal...

No one is attempting to build ladders to the moon though?
No, but some people claim that compressing text into vector spaces and using the patterns to extend bits of text will somehow do more than extend texts in a sometimes plausible, sometimes nonsensical way if we just: add enough data, and process it for long enough.
Not saying its a non-sequitur, but both arguments seem to follow a false premise.
This is the crux of the issue. Whether you think this is like extending a ladder to the moon, or more like we figured out how to get to the moon and are now aiming at Jupiter.
Yes, I've heard that analogy before, but it's more of a question than an answer: is there an unbridgeable gap that prevents continuous improvement, or not?

Researchers will have to figure out whether such a gap exists.

Since I'm speculating, not making a claim, there's no fallacy here.

Anyone who has used AI recently knows how much bullshit the claims are about replacing any human for virtually any task. AI still can't do super advanced things like tell me the correct height of my truck from the manufacturer's tech specs PDF that it has in its databank. Even when I tell it what the correct height is, it'll randomly change the height throughout a session. I have to constantly correct it because thankfully I know enough about a given subject that I know it's bullshitting. Once I correct it, it suddenly admits, oh yeah, actually it was this other thing, here's the right info.

It's an amazing search engine, and has really cool suggestions/ideas. It's certainly very useful. But replace a human? Get real. All these stocks are going to tank once the media starts running honest articles instead of PR fluff.

Exactly. It was a stroke of genius to popularise the word 'hallucinate' instead of 'bullshit' or 'wrong'.

Since it has no fundamental understanding of anything, it's either a sycophant or arrogant idiot.

When I told chatgpt it didn't understand something it obnoxiously told me it understood perfectly. When I told it why, it did a 180 and carried on where I'd left off. I don't use it any more.

Do you have an ETA for when the media will start running honest articles instead of PR fluff? Asking for the entire western world…
(comment deleted)
About the time they stop depending on targeted advertising revenue.
The things feel closer to using a fine-grained search algo with some randomness and a fairly large corpus, than to interacting with something intelligent.

And if you read how they work... that's because that's exactly what they are. There's no thinking going on. When using them, that they've been programmed and prompted to have some kind of tone or personality and to fit within some kind of parameters of "behavior" as if they're a real being reminds me of Flash-based site navigation in the early '00s: flashy bullshit that's impressive for about one minute and then just annoying and inconvenient forever.

As for programming with them, writing the prompts feels more like just another kind of programming than instructing a human.

I'm skeptical this entire approach is more than one small part of what might become AGI, given several more somewhat-unrelated breakthroughs, including probably in hardware.

Like a lot of us, I've gotten sucked into building products with these things because every damn company on the planet, tech or not, has decided to do that for usually-very-bad reasons, and I'm a little worried this is going to crash so hard that having been involved in it at all will be a (minor) black mark on my résumé.

> I'm a little worried this is going to crash so hard that having been involved in it at all will be a (minor) black mark on my résumé.

"I see there's a gap here on your resume, what were you doing between 2021 and 2025?"

"Uh... Prison."

So when it really struggled to get around (kept just walking into obstacles), they gave Claude the ability to navigate by adding pathfinding and awareness of its position and map ID. However, it still struggles, particularly in open-ended areas.

This suggests a fundamental issue beyond just navigation. While accessing more RAM data or using external tools using said data could improve consistency or get it further, that approach reduces the extent to which Claude is independently playing and reasoning.

A more effective solution would enhance its decision-making without relying on direct RAM access or any kind of fine tuning. I'm sure it's possible.

There has to be a better approach, and also in a way that's not relying on reading values from RAM or any kind of fine tuning.

It can't do a good job of reasoning about higher-level abstractions in its long term memory without making poor decisions about which memory items to retain and which to forget.

Would a mixture-of-experts paradigm, where each expert weights the value of short-term memories differently to the weight of long-term memoried, do noticeably better at overcoming that one category of roadblocks?

Seems like the 200k context window is a huge issue and it's summarization deletes important information leading it to revisit solved areas even when it's working properly or simply forget things it needs to progress.
This Sunday there's going to be a hackaton at https://lu.ma/poke to improve the Pokemon-playing agent. I think most hackatons don't achieve much, but maybe someone from HN can go improve the scaffolding and save Claude
> Claude will readily notice when the game tells it that an attack from an electric-type Pokémon is “not very effective” against a rock-type opponent, for instance. Claude will then squirrel that factoid away in a massive written knowledge base for future reference later in the run.

But these models already know all this information??? Surely it's ingested Bulbapedia, along with a hundred zillion terabytes of every other Pokemon resource on the internet, so why does it need to squirrel this information away? What's the point of ruining the internet with all this damn parasitic crawling if the models can't even recall basic facts like "thunderbolt is an electric-type move", "geodude is a rock-type pokemon", "electric-type moves are ineffective against rock-type pokemon"?

Claude definitely does know it (I just checked). Plausibly they’re giving that as an example of other things that it actually needs to save, but yeah, it’s a bad example.
It has trained on multiple guides and walkthroughs and whatnot for the game from the internet. Theoretically it knows the game inside and out, it can recall all of that if you ask about it. It lacks the ability to turn that into something other than text.

To me that shines a light on the claim that there is a real conceptual space limited by the output being generated text.

Claude has no problem recalling type advantages, but it has no metacognition and fails terribly at knowing what it knows versus what it needs to write down.
Same could be said for Sudoku. How many times has it seen natural numbers 1-9 and Sudoku tutorials and board states crawling the entire public internet. And yet they can’t solve a Sudoku or even a half size board on their own.
Well, it's not to play Pokemon. Pokemon is a contrived example to research and display reasoning. That would be a useful step for the real world use-cases that aren't index in fine detail, as a human would. Actually, getting this to work is important for avoiding the thing you're complaining about.
This is the most interesting aspect to me. I had Claude generate a guide to all the gyms in Pokemon Red and instructions for how to quickly execute a play through [0].

It obviously knows the game through and through. Yet even with encyclopedic knowledge of the game, it's still a struggle for it to play. Imagine giving it a gave of which it knows nothing at all.

[0] https://claude.site/artifacts/d127c740-b0ab-43ba-af32-3402e6...

LLMs are, to put it in human brain terms, super, super, super hypertrophied speech centers. The human brain is completely capable of having grown a hypertrophied speech center if that was the path to intelligence. It did not, because that is not the path to general intelligence.

Of course LLMs can't play Pokemon long term. Used this way, they're the AI equivalent of someone who has the beginnings of dementia, who knows it, and is compensating by metaphorically sitting in a corner rocking to themselves repeating things so they don't forget them, because all they can remember is what they said.

It's amazing what they can do. I'm not denying anything they have actually done, because things that have been concretely been done, are done.

But the AIs that will actually fulfill the promises of this generation of AI are the ones yet to come, that incorporate some sort of memory-analog that isn't just "I repeated something to myself inside my token window", and some sort of symbolic manipulation capability.

In both cases, I'm using "some sort of" very broadly. I don't know what that looks like any more than anyone else. For instance, to obtain "symbolic manipulation capability" I don't necessarily mean hooking up a symbolic manipulation package. Humans can manipulate symbols but we clearly do it in a somewhat inefficient and often incorrect way with our neural nets. Even so, we get a great deal of benefit from it. We don't have integrated symbolic manipulation packages, and using the ones that exist is actually a rather rare and difficult skill. But what LLMs do is really quite different from either what humans or software packages do.

However I think it's pretty clear that LLMs aren't really going to get much farther than they have now in terms of raw capability. People will continue to find clever ways to use them, of course, but the raw capabilities of LLMs qua LLMs are probably pretty close to tapped out.

I expect in the future that what we today call "LLMs" will become a component of a system that parses text into vectors and then feeds those vectors into what we consider the "real" AI as those vectors, and the AI will in turn emit vectors back into the LLM module that will be converted to human speech. And I rather suspect those LLMs, since they won't be the thing trying to do the "real work", will actually be quite a bit smaller than they are today, with the bulk of the computational power being allocated to the "real" AI. We won't be hypertrophying the LLM layer to try to provide a poor and tiny memory and maintain the state of whatever is happening because the "real" AI layer will be doing that. The future will probably laugh at us sitting here trying to make the language center bigger and bigger and bigger when obviously the correct answer was to... do whatever it is they did in their past but our future.

So you might say that the future of AI is specialization into purpose-trained structures? So a speech center, a visual center, an object recognition center, a depth perception center, a speech planning center and so on?
In a further future that is inevitable, but in this case I'm referring to an intermediate state where it's probably LLM + one more thing.

Some of the inevitability is optimization. Computers intrinsically admit of certain optimizations that biology doesn't. There's an effect in technology you can notice if you look where a lot of times the hardest part is getting the thing working at all. Once you have a working thing in hand, optimizing it becomes possible. It's hard to optimize something you don't have in hand. Steam engines show this, and I expect that fusion will follow this trajectory too. In this case, for instance, I expect once we have high-functioning computer vision we can start optimizing individual components of it. Eventually it may not even resemble the current architecture, but it's hard to get from here to there without the intermediate phases.

The cerebellum provides an interesting case study in biology, more clearly than the language center of the brain. It's still made out of neurons, but it is structured in a highly stereotypical way for the task it is doing, and does not resemble the "everything connected to everything" architecture used by our artificial neural nets and a lot of the rest of the brain. It is very, very optimized for its particular task. In some ways a lot of it looks more like a specialized and exceeding parallel DSP (albeit, of course, analog) rather than a neural net architecture.

I'm surprised it hasn't indexed some speed runners notes and is able to recreate them. I wonder how it'd do if you asked it to compete in the "any%" speed run category.
Any% Pokemon Red is under a minute and a half long and beats the game using memory corruption and needs specific inputs in a four-frame window. Claude has no concept of time. What do you think is going to happen?
> But despite recent advances in AI image processing, Hershey said Claude still struggles to interpret the low-resolution, pixelated world of a Game Boy screenshot as well as a human can.

> We built the text side of it first, and the text side is definitely... more powerful. How these models can reason about images is getting better, but I think it's a decent bit behind.

This seems to be the main issue: using an AI model predominantly trained on text-based reasoning to play through a graphical video game challenge. Given this context, the image processing for this model is like an underdeveloped skill compared to its text-based reasoning. Even though it spent an excessive amount of time navigating through Mt. Moon or getting trapped in small areas of the map, Claude will likely only get better at playing Pokemon or other games as it's trained on more image-related tasks and the model balances out its capabilities.

We all know the shortcomings of LLMs but its been interesting to observe Agency as a system and the flaws that emerge. For example, does Claude have any reason to get from point A to B quickly and efficiently? Running into walls, running in circles, back tracking, etc. Clearly it doesn't have a sense of urgency, but does it matter as long as it eventually gets there?

But here's what strikes me as odd about the whole approach. Everyone knows it's easier for an LLM to write a program that counts the number of R's in "strawberry" than it is to count it directly, yet no one is leveraging this fact.

Instead of ever more elaborate prompts and contexts, why not ask Claude to write a program for mapping and path finding? Hell if that's too much to ask, maybe make the tools before hand and see if it's at least smart enough to use them effectively.

My personal wishlist is things like fact tables, goal graphs, and a word model - where things are and when things happened. Strategies and hints. All these things can be turned into formal systems. Something as simple as a battle calculator should be a no-brainer.

My last hair brained idea - I would like to see LLMs managing an ontology in prolog as a proxy for reasoning.

This all theory and even if implemented wouldn't solve everything, but I'm tired of watching them throw prompts at the wall in hopes that the LLM can be tricked into being smarter than it is.

I worked for one of a few "game playing AI as a service" startups for several years, and we did in fact leverage the strong programming skills of LLMs to play games. When we pivoted from training directly on human gameplay data to simply having the LLM write modular code to play the game, we managed to solve many long-standing problems in our demo levels. Even on unseen games this works well, since LLMs already have a good understanding of how video games work generally.
That's great that someone out there is solving this stuff, but it begs the question why we're watching Claude fumbling around and not seeing this service in action?
Claude Plays Pokemon is one person's side project to see how well Sonnet can play pokemon. It is a neat LLM benchmark; it's not a serious attempt at making Pokemon-playing AI.
It may not be serious, but it's a true display of an LLMs limitations. A bad look for Claude, and a missed advertising opportunity if someone can do better.
These things are not general purpose AI tools. The are Large Language tools.

There are dudes on YouTube who get millions of views doing basic reinforcement learning to train weird shapes to navigate obstacle course, win races, learn to walk, etc. But they do this by making a custom model with inputs and outputs that are directly mapped into the “physical world” which these creatures live.

Until these LLM’s have input and output parameters that specifically wire into “front distance sensor or leg pressure sensor” and “leg muscles or engine speed” they are never going to be truly good at tasks requiring such interaction.

Any such attempt that lacks such inputs and outputs and somehow manages to have passable results will be in spite of the model not because of it. They’ll always get their ass kicked by specialized models trained for such tasks on every dimension including efficiency, power, memory use, compute and size.

And that is the thing, despite their incredible capabilities, LLM’s are not AGI and they are not general purpose models either! And they never will be. And that is just fine.