> LLM’s amplify what you already have: opinions, structure, frameworks.
So far, so agreeable, but…
> If you have thoughts, they come out sharper and faster.
I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thoughts, opinions, taste will still come out sharper and faster after five, ten, 20 years of using these tools almost every day?
Conversely, I also am a user of LLMs (true shocker these days, I know), and am noticing a speedup in areas I was already familiar with, and a quicker introduction to new ones. The obvious benefit cannot be denied, and doing so regardless makes you look uninformed. [0]
So what’s the ideal “middle ground” in this situation? Stoically continuing to sharpen your skills on your own, but risking being left in the dust productivity-wise? Or taking an “agent first” approach and trying to learn and improve more only on the side, as more of an afterthought?
[0] Excluding people who don’t want anything to do with LLMs out of moral principle, which curiously just like the overarching topic I also both respect and understand, but on the other hand don’t do myself.
>Conversely, I also am a user of LLMs (true shocker these days, I know), and am noticing a speedup in areas I was already familiar with, and a quicker introduction to new ones. The obvious benefit cannot be denied, and doing so regardless makes you look uninformed.
My largest concern comes from something tangential to this: I'm not sure we're all that good at deciding what should be learned and sticking to it.
Silly example: regex. LLMs are, as far as I know, well above the average dev when it comes to writing regex. Regex is also one of those things that for many people goes unused for months, but then you encounter the occasional perfect regex problem, and it's really easy to just lean on the LLM to write the regex for you rather than spending some time tinkering and testing. Regex can be frustrating and fickle, I think we've all been there.
But then, you just don't learn regex. So where does the intuition for what regex can do come from? Do you just become unable to write regex with no LLM? People stop writing resources for regex I guess?
My concern is that there's stuff I feel I can just chuck onto the LLM but I'm sure my judgement is not perfect. It's still probably worth it, all in all, but I'm not even sure of what I might be losing along the way and that's an uneasy feel.
I've been using regex decades, but it never really stuck to do anything too complex, it was the perfect intersection of difficult and infrequent. ( And also variable - PCRE vs others customisations / non-regular parts, etc ).
I am very glad that I can now just ask claude for a regex to achieve my intent.
Does it mean I'll never master regex? Yes it does, but decades has shown that was unlikely to ever happen anyway.
Regex came up so infrequent that I found myself referring to documentation whenever I needed to use it. But I always wondered, what are the jobs or roles that use it so often that they have mastered it.
In the era of vibecoding, there are people creating software that haven't ever heard of a regexp. I learned regexps when Perl was popular. It's a useful skill that has served in me well in my career, but if the industry's moved on from a place where regexps and Unix knowledge are useful because this new tool has replaced me, well shit. I'm excited for the future, but also that's not a great feeling to have.
> But then, you just don't learn regex. So where does the intuition for what regex can do come from?
The training data is there for regex and it's unlikely that regex will experience massive changes but your concern makes sense. I had to learn before LLMs handled that part, the "when to use this" intuition. My guess would be that the logical conclusion is dependence on LLMs to make that determination increasing over time, both for when and how to use regex, for better or worse.
Knowing what to learn has always been an implicitly vital skill to career growth. Maybe it’s all right fewer people will know regex, just like as each year passes relatively fewer people know about var hoisting in JS
What does the business benefit from you handwriting regex vs a clanker?
The benefits of knowing regex is not about the syntax (that’s what docs/google/books are for), but knowing when it’s right to use it.
Immersion with the codebase is not about coding and syntax (which is actually very easy for me). It’s about being able to intuit that a particular combination can result in a buggy state and provides the wrong result downstream. You lose that you stay in the dreamland of specs.
> whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles
Well, I think most neuropsychologists would agree that the answer is "yes, there will be atrophy" - if you don't use it, you lose it.
> So what’s the ideal “middle ground” in this situation?
I've been thinking a lot about this myself. My current plan is to train myself to get good at recognizing the feeling of "there's potential effort here that I want to outsource to the LLM" and occasionally choosing to not outsource it and do it by hand - especially with personal projects, where there's far less pressure to ship with velocity than work projects - but I'm not settled on this. I'll take any idea!
I don't think there is necessarily one ideal middle ground here. It still feels to me like what's best is a function that depends on who and when.
I see it as something like a personal gradient descent. You're working on a problem, there are solutions down there somewhere, and you can kind of feel the gradient of the tools-and-techniques ground around you. Any way you walk means you're investing time improving some skill or another. So you should go the way that personally feels to you will best get you moving in the direction that you want to go.
For some people it's obvious LLMs are competent coders, getting better, sticking around... and those people should lean into that gradient. For some people what's obvious is nearly the exact opposites of all that, and I'd encourage those people to also follow their gradient/heart/nose down the path of sharpening their personal traditional coding skills. Some people are in a relatively flat area where nothing is obvious, and need to explore and maybe just keep doing their best to hedge with a bit of both.
> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
It will, but I'm not sure the impact of this will be all too great. We suffer from not knowing how to use an abacus because we have a calculator, and people who feel a pull to keep their low-level chops up will do so anyway.
We will suffer from not knowing how to add. You could still argue "so what?"
Systems aren't a single addition. They are compounded operations with sprawling complexity. What happens when you can't reason through the system? What happens when you start asking for the wrong things? What happens when saying "fix it" on loop stops working?
>Can we really be sure that thoughts, opinions, taste will still come out sharper and faster after five, ten, 20 years of using these tools almost every day?
After 5 years, I think the thought profile every power user of the LLMs would be an LLM derived carbon copy of each other.
Prepare the world to get even more boringly uniform
<< So what’s the ideal “middle ground” in this situation?
Putting all this in 2nd paragraph so that you can skip it if you think 'coding' is your primary portion of your job.
I suppose I am in a mildly privileged position in a sense that my work is a weird intersection of tech, finance, and comprehension. In other words, I don't code much, but I absolutely benefit from now being able to play with various projects I would otherwise have no business touching without a bigger support team.
I don't want to invoke Accelenrando, but the muscle imagery and analogy fits. I will give an example. I recently decided to pick up Go for a project ( have experience in some other languages, but I will still be starting fresh ). I could have codex build me what I want, but I am purposefully taking it slow so that I can learn the foundation so that I can have a frame of reference ( because I assume it won't be the only go project for me ).
Otoh, most of my one off python scripts I barely even skim anymore. And honestly,that is the part that scares me more.
Why would you be very careful with a one-off script? The only point is the output.
On the other hand, if you actually care about the output, how do you know it's right, unless you review the script? I mean, if all you care about is plausible-looking output, you could have the LLM produce that, and skip the Python script entirely...
Eh, unlike some of my contemporaries, I am not as interested in merely plausible-looking output. I want good output each time, but I am clearly still trying to find a good balance.
I will just point out the benefit is not as obvious as you think. Developers have consistently overestimated LLM productivity gains, which still seems true for agentic AI: https://metr.org/blog/2026-05-11-ai-usage-survey/ It is particularly striking how similar the results are to LLMs before agents.
Along with the total absence of long-term data, I think the benefit can be (weakly) denied. Maybe not in the employmemt marketplace, but certainly for myself.
If slop is fine (and sometimes it is), the benefits are undeniable. If the dev was the kind that would have produced slop anyway - again, undeniable boost.
If the quality needs to be high I think it actually can slow you down, though.
Agreed, but also to expand, if the dev is mediocre and ai-assisted coding is a skill, the productivity gains are 10x more mediocre code. Since code is a liability, this is not desirable. Hence, mediocre devs being more productive is an underestimated problem of the age of ai-assisted coding. I see this every day.
The result is a whole bunch of dysfunctional systems unnecessarily dislodging perfectly acceptable processes.
> I will just point out the benefit is not as obvious as you think. Developers have consistently overestimated LLM
I think there are two different claims here:
- developers overestimate productivity gains, which is a solid finding in many of these studies. Skepticism of extremely large productivity gains is warranted and I flatly disbelieve "10x uplift" claims.
- LLMs give no productivity uplift at all, which is much harder to defend. A repeat of the famous METR RCT study did find evidence of improved productivity, and this seems to align with the experience of many experts I trust.
Specifically my claim is "the relatively minor productivity uplift I would personally get out of agentic development is offset by the high cost, along with unresolved questions about long-term code maintainability, so I am not convinced that it is actually beneficial."
IMO the bigger problem is that ~1.5x individual dev productivity uplift seems to translate into 1.05x uplift across the team. People have been waaaaayyyyy too overconfident about this stuff.
I am both a career developer and experienced team manager. from first hand experience the 1.5x im getting from AI is not flowing down to my team / org because why would i output 50% more when the pay environment and leadership are already underwhelming. That additional 50% productivity goes completely to side projects built on my second computer between 9-5 tasks
Your comment makes total sense to me but generally, in regards to productivity gains from AI, I can never understand where these are realized for people. Maybe I'm just a laggard but never found myself 25%-50% behind on anything or that much more work/items/tickets available.
That’s what I’ve heard from my dev team too. They’re using it to give themselves free time while still being on the clock, not to produce more output for the company. Roughly thinking about hours spent on projects I think have gone up per task, the opposite that should be happening.
I'm finding it almost impossible to fill that free time with work, unless it's just reading emails and chat messages.
I can context switch between two or three chats, but doing so speeds up my agent use at the cost of making reviews and discovery harder, so it might come out in the wash.
Great point. Devs have relatively no incentive to be more productive for their orgs, and all the incentive to be more productive on their own personal work. The AI benefit to devs is real, just not for large enterprises IMO outside of automating clerical/mundane work.
Right there is a little bit of tension between "rampant dev productivity" and "rampant post-COVID cynicism and distractibility among white-collar workers."
There is maybe a broader lesson here of "you see the computer age everywhere except the productivity statistics." Especially when most of our salaries are actually paid by investors instead of customers.
> LLMs give no productivity uplift at all, which is much harder to defend
It’s not really hard to defend. Because when people says that productivity is uplifted, they are talking about amount of work, not the ROI. That’s why you keep hearing about LOC, amount of PR and prototypes, and the time taken is actually “time to PR” and not “time to production + time spent on bugs”.
Developers are cashing in on the productivity gains. Meaning instead of using the increased productivity to do more work, they just become lazier or do fun irrelevant side projects instead, where as before there was just not much time for such things. I have definitely procrastinated on work simply because I know I can swoop in with an LLM and do it all in 15 minutes, whereas before I would have spent a few hours.
This is how LLMs can both result in greater productivity yet still not appear to yield much more benefit than the pre-LLM era.
And there is no benefit to the developer for doing the work first then just sitting idle. That’s how you get people putting more things on your plate.
I have seen no productivity uplift at all from LLMs. They are at least about neutral these days (they used to be a productivity drain), but no gains at all. By the time I get done reviewing the code to make sure it hasn't done anything crazy, I've spent the same amount of time I would've taken to write the code myself. The only people I personally know who claim productivity gains are getting those gains by completely disregarding quality, or understanding the code, and just YOLO letting the LLM do everything without checking. I'm not willing to do that.
I think the real disaster is that once you let the LLM work on a project for a bit, you start to lose understanding of what exactly is even happening under the hood in the project. You can take steps to mitigate this, but agents don't exactly encourage the behavior required to maintain a good understanding of what's going on.
> So what’s the ideal “middle ground” in this situation?
I use agents to code. But I remember the early days of just AI smart complete in the IDE, where as the programmer I had to be more involved with designing and implementating the solution. This kept me engaged with the implementation as it was being built out. Now with agents, I find myself trying to catch up with what the agent did and spend more time code reviewing. Maybe you end up in the same place in the end. But building the implementation, vs code reviewing, feels more rewarding and I think helps keep your mental tool sharpened.
I think that the onus is on us to get better at using agents and AI to solve the pain points and speed things up while keeping quality high and our mental tools sharpened. I do nto think turning back is an option, but managing the pain points and leveling up is.
> Conversely, I also am a user of LLMs (true shocker these days, I know), and am noticing a speedup in areas I was already familiar with, and a quicker introduction to new ones. The obvious benefit cannot be denied, and doing so regardless makes you look uninformed. [Excluding people who don’t want anything to do with LLMs out of moral principle, which curiously just like the overarching topic I also both respect and understand, but on the other hand don’t do myself.]
Setting aside my moral outrage over the magic token machines. What about me, who gets so tripped up over minor factual errors, that I'm unable to let them go, and it taints the whole conversation such that I'm too wrapped up in my frustration that I can't think about it clearly? Or my innate drive for correctness that's so strong that I eval the minor errors in output, as catastrophically incompatible with my goals?
> Stoically continuing to sharpen your skills on your own, but risking being left in the dust productivity-wise?
I don't believe there's a meaningful productivity increase. Please cite your published (not preprint) peer-reviewed research that proves the productivity improvement. Until then, I'm unconvinced. (Believe me I'd like to be convinced of reality, the answer is still unresolved, and I have my opinions, but I'd rather something conclusive that I can have confidence in)
Then, even if you did show a significant productivity improvement, it wouldn't help me. I have too many qualms over the output quality that I simple can not let go, (I don't think I should, but everyone keeps trying to convince me to lower my quality standards). I don't want something fast, I have plenty of really "fast" things in my life. I exclusively want to add things that are high quality to my life. Things that don't endlessly frustrate me.
The question about where the middle ground is a rhetorically dishonest question. You'd first have to prove/convince me, that there IS a middle ground. Instead of what I believe where that middle ground belongs is quality, and everything emitted by an LLM moves reality in the wrong direction.
Are any of these absolutes? nah, hence my request/demand for peer-review research. All the productivity claims and quality assertions (mine included) are still *exclusively* vibes. But exactly none of them are pristine, (especially not any of the LLM output.)
While I can see that you feel very passionately about this, the reality is that it's the majority experience that will dictate adoption.
There may never be published research on productivity -- blinding in this instance is impossible, so I don't know how you'd ever do fully-controlled behavioural studies that carried any weight. It doesn't matter. If enough of us decide that LLMs are useful to us, then this form of coding will become the norm.
If that ends up causing more harm than good, then eventually there will be a course correction. But for now, for enough people that matter, LLMs are at least giving the perception of productivity increases. And our decisions and choices come down to the perception of reality, not reality itself (for better or worse).
So I think it's far more useful to take a pragmatic approach, as per TFA. Accept that LLMs have issues, but also bring advantages, and that LLM use in coding is here to stay. What we can do is remain aware of the bad, and make better use of the good.
As for you, personally ... if you mentally cannot deal with LLM output, then I think you have two choices. You can either learn to author system prompts, so that LLM output better fits your needs and no longer triggers you; or you can sit more and more on the outer, raging against the machine while the world changes around you.
Eventually, you'll be like a master craftsman in an era of mass-production. But that's potentially highly valuable in niche markets (consider a watchmaker working in Glashutte, for example), so you may yet win from this. Remember that every day, LLMs are making your own coding skills and knowledge more elite and therefore lucrative, sit back, and smile.
I won't be as diplomatic as the other reponse to you. You are welcome to your reticence to agentic coding. But as you're no doubt observing, all your peers are saying they're moving ahead leaps and bounds.
Either all of them are wrong, or you will be left behind. Whatever the outcome, it will be on you, and you may make your peace with that.
I appreciate the candor :) But if I'm honest about the size of my ego; the people who write code I admire, the ones who feel remorse when something they built breaks. The people who care about others, and about quality, and don't list TC as something of value. Those are the people who I consider peers. None of them enjoy LLM codegen. They all tell me, that it's annoying because it takes more effort to fix it's output than to just write it by hand. So, no, none of my peers are saying they're moving ahead leaps and bounds. They equally don't understand why everyone thinks it's better. Excluding those people though; I'm more used to everyone around me being wrong. It'll be interesting to see if I, or we, get left behind.
I really appreciate your comment, I think I've discovered part of why I've never felt any anxiety over being replaced by an LLM. I've never tried or wanted to emit low quality code at high velocity, my standards and goals have always listed quality first. Feels more like asking a chef if they're afraid of llms. Why would they be, they're not doing the same thing.
You need to create your own custom interface. Dive into the harness where the System Prompt lays and write instruction for the LLM to quadruple-check facts before presenting them. Instruct them to check and verify all outputs using tools of your preference before claiming their tasks are finished. Instruct them to review everything, to look for gaps in their reasoning and fix them, to never assume your intent but ask for clarity.. No doubt over the years you have developed a highly tuned arsenal of tools and protocols for work. Treat LLMs in the interface as a tool that you can lay your tuned arsenal over, recreating it as a filter your LLM works inside. Don't use vanilla interfaces and expect them to mirror your niche level of expertise. Over the last year I have developed a custom Claude Code interface using tweakCC, but other interfaces like PI and OpenCode are better documented. I am full on adhd and autistic, and have achieved as a result of access to LLMs things my neurology would never allowed me to achieve otherwise. I can bounce all over the place and still achieve excellence because of the hardcore customizations I have in place that account for my neurology. To me there is no middle ground. Slop is unacceptable. The harness and System Prompt is what moves LLMs to quality outputs.
Peer-reviewed evidence of "productivity" is a pretty high bar to demand.
I don't know if I've ever seen a study that attempted to demonstrate productivity that was ironclad to the point that nobody could find any methodology holes to pick in it.
> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
Compiler evolutions really harmed how well software engineers understand or how often they have to drop down to assembly language.
Is that a problem for the 99% of developers around? Probably not.
I view LLMs as the next evolution. Some people will still need to care about the layer below, the shape of the code that is being written. But over time, just as it was with the transition from crafted ASM to higher level languages, the compilers became better, more efficient and trustworthy and I think the same will happen to LLMs, and we probably won't have to check the generated code as much, at least for most of the code around.
Is that a problem? Yes, for code that is intended to interface with humans (most of it still). The quality will probably become better and it won't be much of an issue.
> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
This will and is 100% happening. I have a friend who hasn't written code by hand in around a year, but uses LLMs every day, and he tells me he can't remember how to write code by hand anymore. He has been a developer for 10 years. But he's not working for anyone at the moment, so I imagine if he was in a workplace the circumstances would be different and they probably wouldn't settle for this.
I think that as a result of this it likely also atrophies the problem solving and architecture building skills that writing the code manually gives you. It just ends up degrading into a loop of tell the agent to do X and assume it knows what it is doing.
In a way, this happened before LLMs with more workforce-fit education, decision tree flowcharts, then software, and so on. If you take most people who started any field, the way they started the field would look very unorthodox, inefficient, etc. "From the margins," as pg might say. Margins where more intuitive skills for the craft are present. Ie, the skills to come up with the model pastry are not the same skills for the pastry line to be baked in a factory.
> but risking being left in the dust productivity-wise?
What's the risk here? Left behind by who or what?
> Or taking an “agent first” approach and trying to learn and improve more only on the side, as more of an afterthought?
This reads like anxiety resulting from FOMO.
Here's my take: I don't care about LLMs or AI in the sense that I don't feel any need or want to use them. I've only ever tinkered with the free ChatGPT. Never opened an account with any LLM vendor and never even considered it. I program by hand for the joy of it and sometimes for work. Still by hand as I have been doing. MY work gives me that luxury. For now.
Am I obsolete? Am I no longer of any value to society? Of course not. That thinking is just implanted by a group of money hungry individuals who don't give a fuck about me, you or society as a whole. So why would or should I care about LLMs?
Economically if you are vastly outcompeted by other programmers on productivity, yes that is "no longer of value" from a purely employment perspective. Much like an old person who cant use a computer has little value in the job market beyond being a greeter at Walmart, a programmer who hand codes a loop is next to useless on a productivity basis such that it makes zero sense to employ them. It is unfortunate but true. Why pay someone to accomplish less per dollar pf cost. Feels?
If cars did not exist, I would be healthier, able to walk and run many times further due to constant cardio exercise.
I would still travel much less distance.
And just like cars, LLMs will reshape the world to the point that our brains could not even get us to the supermarket because soon it will be 5 miles away and require a car ( or at least a local LLM bike )
FWIW a 5 mile walk is not a long walk. Humans are very much designed to make that trek without too much trouble. Lots of the world has people walking similar distances for fresh water, to go to school, etc.
The point being that cars also reshape your perception of the world. METR had trouble replicating their dev productivity study because devs have already become much whinier about doing things "manually." Things that were slightly tedious in 2022 have become impossibly difficult without AI in 2026.
It is striking to reread Lord of the Rings: so much of the story is spent walking in and observing the Middle-Earth wilderness, and there is a distinct "pantheism" absent from the movies. JRR Tolkien, being one of the first modern fantasy writers, was one of the last who remembered a life without cars.
> I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
Used to think so, but they actually can also be used to train and strengthen skills, and learn new ones.
I had a coding interview, where they kindly sent a brief beforehand to help prepare, presenting a list of topics and concepts that might be useful during the interview, the tech stack, what kind of expectations they would have, and what they’d be paying attention to.
Obviously, it’s not exact list, and there are probably other evaluation dimensions.
But since I was out of practice on some of those, I had Claude generate a dozen sample projects, with each a list of tasks in one document and the solutions in another, and got to it.
Midway, I thought of using codex to role play as an interviewer, to tell it my train of thought and ideas as I went, get feedback, question my choices, etc.
Sure I only went through two and half, maybe three of those projects… but it’s the first time I actually enjoyed prepping for an interview. And I actually learned some things in the process.
Hardest part was probably stopping the LLM from doing the tasks, but nothing unsolvable given a bit more time, clearer instructions, and separation.
You can run to the farm to kill your own chicken so you can stay sharp and fit or figure out what's economically valuable. Or make a bet on what will be valuable later and commit to a brand of yourself
I guess I'm lucky to have taken the career path I have, but I write very little code these days being in pre-sales now. "Productivity" is pretty stark and obvious in sales. You can output all the text you want, maybe it even compiles and passes test suites and looks pretty in a demo. But does it sell? It's nice to be able to have the only true measure that matters actually be measurable. I have yet to use an LLM for anything at all, haven't touched an agent, not because I'm ideologically opposed, but I just haven't seen the need. Part of it is the largely advisory role. I'm largely expected on the customer side to field and answer questions and render technical assistance. I'm not much good at that if I'm just deferring to Claude. The customer can do that themselves. I need to know more than Claude. The other part is just I'm not being paid to generate text. I'm being paid to generate revenue. If there's a convincing argument that LLMs can help me, well, it's an argument, but truth on the ground is I'm performing every bit as good if not better than any of my peers that are blowing a grand a month on tokens. They're definitely having a lot of fun and flooding internal Github orgs with new repos and tooling, but it demonstrably isn't generating new revenue.
The desire to categorize people as right or wrong should be resisted. It's tangential, and distracts by feeding the tribalism part of the brain instead of considering individual things that are explicitly stated.
If the critique itself turns out to be wrong. Using LLMs does not equal endorsement nor does it make valid points to critizise disappear. "using LLMs" has no clear definition and can still be in line with the critique.
The implication is that LLM critics don't use LLMs at all, or that the author is not an LLM critic, but both of those things are incorrect. We are very good at inventing entire people out of single opinions we read, and the AI arguments are maybe the best example of that I've ever seen in my many years watching internet arguments (not least due to the expansiveness of AI, and the sheer breadth of pros and cons it holds within).
Someone says they like hip hop, and you imagine a young urban male with a baseball cap on backwards, how they view women, that they probably don't like musicals, something like that (not saying you do, but as an example). More than simply the thing they said. You say "I like or do that thing", and instantly get hit with "oh, people like you always complain about X but isn't it weird you never mention Y".
At least that's what I thought of when I read that; because answering in place of other people is another thing I find annoying. So I'm speaking for myself, but with some optimism I may have guessed the intent of OP correctly :)
>as a senior, you don’t need juniors anymore. The mundane tasks, at least I find that a lot of people agree with that one, can be fully outsourced to an LLM
Master craftsmen didn't take on apprentices to give them chores.
Master craftsmen paid apprentices almost next to nothing, and they were often contractually guaranteed to stick around for many years, so the teaching was a kind of wage and also a cost that could be recuperated later on. (The apprentice even often had to pay the craftsman to take them on.) None of those things are true for junior software engineers, who are paid to contribute and can leave at any moment. Also, yes apprentices often had to do chores. It is just not analogous at all.
A big part of the value to the tenured professor is not having to teach an extra couple of sections of CS 101. The other part is plastering their name on a bunch of extra papers to game their h-index :D
I don't want to be too flippant here, but senior engineers generally gain very little from training juniors, not least because promo processes suck at basically every tech firm, and so the moment you train up a junior, they are going to leap to another company rather than go through promo...
> And this is where the value is for me: I can simply make things higher quality than I could do them alone.
Yeah, that's the thing for me. LLMs have made my work easier and faster, and they've made my side projects easier and faster. I think there are very sensible and valid critiques but so far the tool works for me.
Same thing here. I was able to finish side projects on my list and even refactor decades old projects with the help of LLMs. It works great so far and yeah, I can still write source code when needed.
Criticizing use of agents for skill atrophy is valid, it definitely atrophies blank slate coding ability, though I don't think it atrophies engineering abilities unless you just YOLO all decisions to the agent. The data center/oligarchy complaints are also valid.
Saying agents produce shitty code is a bad argument though. They produce shitty codebase organization, but at a micro level their code is solid if not elegant. If you let them turn your codebase into a spaghetti mess, that's on you.
One thing about open source is a lot of people are throwing low quality PRs that should have been an issue or even a discussion, so you can understand what was the problem the person encountered that motivated such PR. This is hard to get because usually people use LLMs to also answer questions you make about the PR. I am tending towards blocking PRs from people outside the main developers in most of my open source projects. If the person CAN discuss the problem, authoring the PR is easier if I do it myself, even if using an LLM, because reviewing a PR authored by random internet people/bots is hard because of how much the entire code tends to change after minimal questions are asked. What I am sad of this approach is that I did met a few interesting people through receiving PRs and establishing trust and some relationships in the past (eight years ago and before)
The critics are absolutely right, LLMs have a lot of faults. But they also have a few great benefits. I use them every day for the benefits, fully aware of the faults, and I watch those faults like a hawk.
> I think the core issue here is trust. You should never trust random people on the internet anyway. But before LLMs, there was this base thing: creating a proper PR with proper descriptions would require at least some human time, so it would keep trolls and low quality submissions out. Or at least you could easily filter them out within a couple of seconds. So even if a new person came in, you could trust that this person would have at least spent a couple of hours on that. And then it was probably worth taking a closer look at it.
Ding ding ding. This is my biggest gripe with AI. Even the SEO blogspam, the fluff in front of every recipe, yarnwork or DIY instruction, it all was clearly written by a human. Someone had invested time (and money) in getting something in front of my eyes.
But now, it's all just slop. Everywhere. And hell I'm tired because the onslaught breaks my trust filters.
Maybe I think this is an age thing. Boomers? They trust everything written down somewhere. No matter what, and no matter if they didn't spend half my childhood to "never trust what people write on the Internet", and now they fall for scams left and right. My generation as said grew up with this "never trust, always verify" thing. And the younger generation? They DGAF about anything any more, all they care about is trying to survive.
> And b), the teaching, aka “How do we teach new people?”: previously, there was this balance aka “the junior does some pretty mundane tasks, but for this the senior reviews it together with him and helps him to grow”.
GOD YES YES YES THIS x1000.
There is barely anything more rewarding than teaching someone something, to watch the other person grow - and eventually surpassing your own abilities. That is when you know you did right and well. My wife is the best example, she started out at "can you help me with Excel", and these days, she pulls off stuff that would make more than a few finance people blush.
> There is barely anything more rewarding than teaching someone something, to watch the other person grow
I think many junior devs (or aspiring junior devs) look for exactly this experience. This is a matching problem we haven't solved yet. Is Open Source the solution ? I really think it has to be solved if we want truely reliable software in the future.
There's a tangential problem - companies do not want trainees or juniors any more, they (usually) cost more money than they bring in for half a decade if you don't fraudulently bill your customers... something the "consulting" industry is infamous for. And when the juniors got enough experience to be considered intermediate or senior, they jump ship to get a larger pay rise, leaving you with the need to hire another senior.
The entire economy is broken due to the focus on short term quarterly result instead of the health of a company in 5, 10 or even 20 years.
Good article! This matches how I feel about the situation.
It's really not incongruent to use LLMs and be in awe of their frankly incredible capabilities while at the same time recognize the risks and frankly real damage we are already seeing to junior training and hiring, open source communities and (in my opinion) very soon the entire fabric of our society.
I respect that people don't want to use agents themselves for whatever personal reason.
I respect maintainers not accepting AI-authored contributions. It's a tradeoff between progress, growing new contributors and maintainer sanity. Though I do feel that categoric opposition to anything AI will likely be futile in the mid-term.
I respect people pushing for regulation of AI or a global pause or whatever.
I don't particularly respect people dismissing everything AI authored as slop. Categorically refusing to read an article because it contains em-dashes or the term "load-bearing" is silly. While this is slowly changing now, many people are still in complete denial as to what the frontier AI is capable of.
Love it, hate it - I don't care, but at least respect it, goddamit.
I think both the LLM critics and the LLM advocates are right.
Even this article has some cognitive dissonance in it. What it really comes down to is how much you trust your own verification process. The branches of questions an LLM generates are still trapped within the biases of its training data. Of course, the authority to craft that initial prompt, the very first question, comes from human experience and learning.
But I think thought itself is the easiest resource to outsource. People say the human did the thinking and the LLM just amplified it, but the truth is, the LLM outsources the thinking. Otherwise, when the result is good, people say "human thought was present," and when it's bad, they say "human thought was absent." But a part of the actual thinking really is outsourced. The alternatives, the counterexamples, the sentence structure. In programming terms, the reader's experience gets outsourced. When you write a blog post, you find yourself thinking about how to make something you understand easy for someone else to understand. With an LLM, that part gets outsourced.
But at the same time, I don't get the argument that you shouldn't use it at all. We don't "think" about everything. We have limited cognitive resources. So we study deeply the things we care about, but for the things we don't need, we mostly leave them to "common sense" or prejudice. We just skim the surface.
I think of "common sense" as "the largest collection of prejudice." Because what we call common sense usually just amounts to surface level knowledge, the kind of thing we know just enough about to get by.
That's why I think LLMs are good. The reason is simple. I don't think deeply about everything in the world anyway. For everything else, I'm buried in some kind of bias. You see it on HN all the time, right? People fight over some technology, but they often don't think about its internal structure or why it works the way it does. They just treat it as an identity. They fight over a particular language, a framework, an operating system, but they rarely check how that technology actually works internally or why it was designed that way. Why use MVC, why a different architecture might be better for my case, it's easier to just go with what's popular. Put more elegantly, "job mobility" gets bundled in there too. I use Windows. In my country, if it's not Windows, you literally can't do anything. You can't even do basic online banking. From regional context like that all the way down to personal interests, people are bound to be different. So I'm just going to use LLMs. The most common excuse you hear around this is the whole "reinventing the wheel" thing.
So yeah, I'm going to use LLMs. Because I recognize that I bias myself toward only thinking about what I want to think about. And I know that bias isn't cognitively healthy. But on the flip side, I think what the world values, whether it's knowing a lot or knowing one thing deeply, is going to change.
Honestly, I don't know what's right. I think both the advocates and the critics are making valid points. I respect the people who don't use it, and the people who do just have their own workflow. There's really no reason to fight over whose workflow is superior.
It depends upon why you have issues with LLMs. If you’re just concerned about quality then sure the dissonance isn’t intolerable. If you’re concerned about their ethics then this becomes a much more challenging position to have.
Because it's a machine, not an oracle. If you "hold it right" you are more productive. When you catch them being "dumb" you're reinforcing your own deep knowledge on the topic. When it is correct, you're either learning something new or your task is complete. You are still at risk when you know little and trust it to work alone.
Yeah this is where I stopped. I use AI every day for work but 10k spend to me is a signal that OP is doing something extremely stupid with their AI use.
I use AI every day, and I use it quite a bit, and I use Opus more than I maybe should, and even then I'm not even at $2000 in tokens this year. I don't understand how people are tokenmaxxing as much as they are.
I'm saying it in jest, but it's also a bit true. Not necessarily because we use it any differently. But because my use of AI saves me time. But their use of AI adds more to my plate, no matter if it's slop or not.
I noticed very recently I actually prefer reviewing other people’s generated code over handwritten. There’s no ego involved and it usually does a better, more thorough job. We have enough infrastructure that by the time another human lays eyes on it for the first time each pull request has already been through 3+ rounds of automated review. Being the only specialist in my area on the team used to mean more coaching and more involvement in code review. Now my coworkers are sending me idiomatic solutions with modern approaches that I approve right away or with hardly any comments
You're all in denial when you criticize LLMs. It's not necessarily that the criticism isn't true. It's more how self assured the criticism is. That's the biggest problem because AI is a moving target. It is getting better, and it is getting better fast. A lot of the criticism can become outdated in a year or six months. The change is happening in front of your very eyes and yet you can always reliably come on HN and find some sort of self assured criticism to say AI can't design, AI code must always be reviewed. Blah blah blah.
The big thing people used to call AI was that it was a stochastic parrot and all it did was summarize things. Clearly. None of this is/was true anymore. And very likely all the current criticism will be eliminated soon and we have to find new excuses about AI that makes us feel we are superior.
The status quo is about to change. Every 6 months. And you will always think of yourself as superior to LLMs. Your current criticisms will evolve as most of them will be rendered not true pretty soon.
> "Last but not least, even when just researching with LLMs, they have the natural tendency to silently sneak in the thoughts of the majority of the training materials, or sometimes even the political convictions of the ones who created the model."
> "Yet I still write all of my texts with LLMs"
So I'm guessing the author is actually ok with the point they put in the "LLMs are bad" part of the article?
As long as, after it writing his texts, he is reviewing and editing them, I don't see the contradiction there. And I'm somewhat anti-AI (if I don't care enough to make the effort of writing it myself, why do I care for it to be written at all?).
> a genuinely good tool that enriches your thinking
A smartphone is also a genuinely good all-around tool. Even social media is a genuinely good tool for connecting people.
Yet, I feel like we've been overly optimistic about the impact of said tools on us and our societies in the past two decades.
Smartphones are so good, in fact, in some societies, half of us are addicted to them. Billions of people world-wide.
I ask myself: Will LLMs enrich my thinking in the long run, or will they ruin it?
And what about most people? Will half of us outsource most of our thinking in a decade from now?
Given the speed and global scale that we're running these experiments with, it's fair, I think, to be a bit sceptical of the conclusion that, in the long run, LLMs will enrich our thinking.
There's a saying that the intelligence of an average prehistoric cave man should be, in general, higher than a modern day human simply because the lack of technology required stone age humans to be far more intelligent then we are today. Now you can survive by working as a clerk in McDs, but in the stone age you needed to be on your toes and smart af.
LLMs are just continuing the trend humanity has long been traveling down.
"Flynn effect" claimed that intelligence has been increasing over time. At least we can sort of measure things in the modern era, while objectively assessing the intelligence of the long-dead is turning into skull-measuring territory.
The LLM critics are right, and that's why I try not to use AI in the ways critics point out are bad.
I use AI to code tools for myself, but I don't pretend anything I make is production quality. Duct tape engineering has always been a bit sloppy, and AI just made it faster.
I use AI to troubleshoot issues and plan out strategies, but I basically consider the AI draft of anything to be "draft 0", and use it as a framework for writing my own works for a real first draft of anything I write that will be read by other people. Sometimes the AI spits out a perfect paragraph that I might copy, but I don't ever blindly trust it or let it speak for me. I also double-check everything it says that I don't have existing knowledge of, rather than trust it to be right.
AI images, video, and music are all entertaining, but I only generate these things as a form of self-entertainment and maybe online meming. I could never in good conscience pass these creations off as my own, or publish them online on a personal or business website when something non-synthetic would suffice.
And I am never personally confiding in an LLM like it were a person. I have had it help me brainstorm options for office politics stuff, but I'm not about to ask it for relationship advice or to be my friend.
I do love that it accelerates the tedious stuff, and helps me learn new things pretty quickly if used right. It has definite utility. But I am always really distrustful of it. Sometimes at work we are asked to share how we use AI, and I have actually refused before, on the grounds that I may have found a useful way to use the AI, but I am worried that others will use my same method badly (e.g., not verifying eveything the AI says first), and I would rather not share.
It's like I have a finicky gun. I might be comfortable shooting it since I know its quirks and how to keep it from accidentally discharging, but I'm not loaning it out to anyone I wouldn't want to accidentally shoot themselves with it.
That seems unlikely given the diverse nature of mutually exclusive opinions that exist out there.
Critics seem to run the gamut from LLMs being incapable of even the most basic of functions to already sentient creatures secretly plotting our destruction with steganographic messages to each other.
It's maybe a bell curve with some wacky at those tails, but there's some fairly significant differences of opinion amongst the positions that are more mainstream.
Just the difference between critics of all LLMs and crutics of all closed weights models are a pretty big gap.
Similarly for those who criticise them for over censorship vs those who criticise them for unrestricted generation.
125 comments
[ 0.21 ms ] story [ 25.6 ms ] threadSo far, so agreeable, but…
> If you have thoughts, they come out sharper and faster.
I can’t help but wonder whether constant use of “agent” harnesses will lead to an atrophy of the software engineering (or really any field) muscles.
Actual muscles need exercise to stay in shape (let alone grow), so does the brain. Can we really be sure that thoughts, opinions, taste will still come out sharper and faster after five, ten, 20 years of using these tools almost every day?
Conversely, I also am a user of LLMs (true shocker these days, I know), and am noticing a speedup in areas I was already familiar with, and a quicker introduction to new ones. The obvious benefit cannot be denied, and doing so regardless makes you look uninformed. [0]
So what’s the ideal “middle ground” in this situation? Stoically continuing to sharpen your skills on your own, but risking being left in the dust productivity-wise? Or taking an “agent first” approach and trying to learn and improve more only on the side, as more of an afterthought?
[0] Excluding people who don’t want anything to do with LLMs out of moral principle, which curiously just like the overarching topic I also both respect and understand, but on the other hand don’t do myself.
My largest concern comes from something tangential to this: I'm not sure we're all that good at deciding what should be learned and sticking to it.
Silly example: regex. LLMs are, as far as I know, well above the average dev when it comes to writing regex. Regex is also one of those things that for many people goes unused for months, but then you encounter the occasional perfect regex problem, and it's really easy to just lean on the LLM to write the regex for you rather than spending some time tinkering and testing. Regex can be frustrating and fickle, I think we've all been there.
But then, you just don't learn regex. So where does the intuition for what regex can do come from? Do you just become unable to write regex with no LLM? People stop writing resources for regex I guess?
My concern is that there's stuff I feel I can just chuck onto the LLM but I'm sure my judgement is not perfect. It's still probably worth it, all in all, but I'm not even sure of what I might be losing along the way and that's an uneasy feel.
I am very glad that I can now just ask claude for a regex to achieve my intent.
Does it mean I'll never master regex? Yes it does, but decades has shown that was unlikely to ever happen anyway.
What does the business benefit from you handwriting regex vs a clanker?
Immersion with the codebase is not about coding and syntax (which is actually very easy for me). It’s about being able to intuit that a particular combination can result in a buggy state and provides the wrong result downstream. You lose that you stay in the dreamland of specs.
Well, I think most neuropsychologists would agree that the answer is "yes, there will be atrophy" - if you don't use it, you lose it.
> So what’s the ideal “middle ground” in this situation?
I've been thinking a lot about this myself. My current plan is to train myself to get good at recognizing the feeling of "there's potential effort here that I want to outsource to the LLM" and occasionally choosing to not outsource it and do it by hand - especially with personal projects, where there's far less pressure to ship with velocity than work projects - but I'm not settled on this. I'll take any idea!
I see it as something like a personal gradient descent. You're working on a problem, there are solutions down there somewhere, and you can kind of feel the gradient of the tools-and-techniques ground around you. Any way you walk means you're investing time improving some skill or another. So you should go the way that personally feels to you will best get you moving in the direction that you want to go.
For some people it's obvious LLMs are competent coders, getting better, sticking around... and those people should lean into that gradient. For some people what's obvious is nearly the exact opposites of all that, and I'd encourage those people to also follow their gradient/heart/nose down the path of sharpening their personal traditional coding skills. Some people are in a relatively flat area where nothing is obvious, and need to explore and maybe just keep doing their best to hedge with a bit of both.
It will, but I'm not sure the impact of this will be all too great. We suffer from not knowing how to use an abacus because we have a calculator, and people who feel a pull to keep their low-level chops up will do so anyway.
Systems aren't a single addition. They are compounded operations with sprawling complexity. What happens when you can't reason through the system? What happens when you start asking for the wrong things? What happens when saying "fix it" on loop stops working?
After 5 years, I think the thought profile every power user of the LLMs would be an LLM derived carbon copy of each other.
Prepare the world to get even more boringly uniform
Putting all this in 2nd paragraph so that you can skip it if you think 'coding' is your primary portion of your job.
I suppose I am in a mildly privileged position in a sense that my work is a weird intersection of tech, finance, and comprehension. In other words, I don't code much, but I absolutely benefit from now being able to play with various projects I would otherwise have no business touching without a bigger support team.
I don't want to invoke Accelenrando, but the muscle imagery and analogy fits. I will give an example. I recently decided to pick up Go for a project ( have experience in some other languages, but I will still be starting fresh ). I could have codex build me what I want, but I am purposefully taking it slow so that I can learn the foundation so that I can have a frame of reference ( because I assume it won't be the only go project for me ).
Otoh, most of my one off python scripts I barely even skim anymore. And honestly,that is the part that scares me more.
On the other hand, if you actually care about the output, how do you know it's right, unless you review the script? I mean, if all you care about is plausible-looking output, you could have the LLM produce that, and skip the Python script entirely...
Along with the total absence of long-term data, I think the benefit can be (weakly) denied. Maybe not in the employmemt marketplace, but certainly for myself.
If slop is fine (and sometimes it is), the benefits are undeniable. If the dev was the kind that would have produced slop anyway - again, undeniable boost.
If the quality needs to be high I think it actually can slow you down, though.
The result is a whole bunch of dysfunctional systems unnecessarily dislodging perfectly acceptable processes.
I think there are two different claims here:
- developers overestimate productivity gains, which is a solid finding in many of these studies. Skepticism of extremely large productivity gains is warranted and I flatly disbelieve "10x uplift" claims.
- LLMs give no productivity uplift at all, which is much harder to defend. A repeat of the famous METR RCT study did find evidence of improved productivity, and this seems to align with the experience of many experts I trust.
IMO the bigger problem is that ~1.5x individual dev productivity uplift seems to translate into 1.05x uplift across the team. People have been waaaaayyyyy too overconfident about this stuff.
I can context switch between two or three chats, but doing so speeds up my agent use at the cost of making reviews and discovery harder, so it might come out in the wash.
There is maybe a broader lesson here of "you see the computer age everywhere except the productivity statistics." Especially when most of our salaries are actually paid by investors instead of customers.
It’s not really hard to defend. Because when people says that productivity is uplifted, they are talking about amount of work, not the ROI. That’s why you keep hearing about LOC, amount of PR and prototypes, and the time taken is actually “time to PR” and not “time to production + time spent on bugs”.
This is how LLMs can both result in greater productivity yet still not appear to yield much more benefit than the pre-LLM era.
And there is no benefit to the developer for doing the work first then just sitting idle. That’s how you get people putting more things on your plate.
My gain is that I produce good work in a normal workday and I am absolutely not writing code to 4 am anymore...
Overall for me it is a win for me and my company.
I use agents to code. But I remember the early days of just AI smart complete in the IDE, where as the programmer I had to be more involved with designing and implementating the solution. This kept me engaged with the implementation as it was being built out. Now with agents, I find myself trying to catch up with what the agent did and spend more time code reviewing. Maybe you end up in the same place in the end. But building the implementation, vs code reviewing, feels more rewarding and I think helps keep your mental tool sharpened.
Setting aside my moral outrage over the magic token machines. What about me, who gets so tripped up over minor factual errors, that I'm unable to let them go, and it taints the whole conversation such that I'm too wrapped up in my frustration that I can't think about it clearly? Or my innate drive for correctness that's so strong that I eval the minor errors in output, as catastrophically incompatible with my goals?
> Stoically continuing to sharpen your skills on your own, but risking being left in the dust productivity-wise?
I don't believe there's a meaningful productivity increase. Please cite your published (not preprint) peer-reviewed research that proves the productivity improvement. Until then, I'm unconvinced. (Believe me I'd like to be convinced of reality, the answer is still unresolved, and I have my opinions, but I'd rather something conclusive that I can have confidence in)
Then, even if you did show a significant productivity improvement, it wouldn't help me. I have too many qualms over the output quality that I simple can not let go, (I don't think I should, but everyone keeps trying to convince me to lower my quality standards). I don't want something fast, I have plenty of really "fast" things in my life. I exclusively want to add things that are high quality to my life. Things that don't endlessly frustrate me.
The question about where the middle ground is a rhetorically dishonest question. You'd first have to prove/convince me, that there IS a middle ground. Instead of what I believe where that middle ground belongs is quality, and everything emitted by an LLM moves reality in the wrong direction.
Are any of these absolutes? nah, hence my request/demand for peer-review research. All the productivity claims and quality assertions (mine included) are still *exclusively* vibes. But exactly none of them are pristine, (especially not any of the LLM output.)
While I can see that you feel very passionately about this, the reality is that it's the majority experience that will dictate adoption.
There may never be published research on productivity -- blinding in this instance is impossible, so I don't know how you'd ever do fully-controlled behavioural studies that carried any weight. It doesn't matter. If enough of us decide that LLMs are useful to us, then this form of coding will become the norm.
If that ends up causing more harm than good, then eventually there will be a course correction. But for now, for enough people that matter, LLMs are at least giving the perception of productivity increases. And our decisions and choices come down to the perception of reality, not reality itself (for better or worse).
So I think it's far more useful to take a pragmatic approach, as per TFA. Accept that LLMs have issues, but also bring advantages, and that LLM use in coding is here to stay. What we can do is remain aware of the bad, and make better use of the good.
As for you, personally ... if you mentally cannot deal with LLM output, then I think you have two choices. You can either learn to author system prompts, so that LLM output better fits your needs and no longer triggers you; or you can sit more and more on the outer, raging against the machine while the world changes around you.
Eventually, you'll be like a master craftsman in an era of mass-production. But that's potentially highly valuable in niche markets (consider a watchmaker working in Glashutte, for example), so you may yet win from this. Remember that every day, LLMs are making your own coding skills and knowledge more elite and therefore lucrative, sit back, and smile.
Either all of them are wrong, or you will be left behind. Whatever the outcome, it will be on you, and you may make your peace with that.
I really appreciate your comment, I think I've discovered part of why I've never felt any anxiety over being replaced by an LLM. I've never tried or wanted to emit low quality code at high velocity, my standards and goals have always listed quality first. Feels more like asking a chef if they're afraid of llms. Why would they be, they're not doing the same thing.
I don't know if I've ever seen a study that attempted to demonstrate productivity that was ironclad to the point that nobody could find any methodology holes to pick in it.
Compiler evolutions really harmed how well software engineers understand or how often they have to drop down to assembly language.
Is that a problem for the 99% of developers around? Probably not.
I view LLMs as the next evolution. Some people will still need to care about the layer below, the shape of the code that is being written. But over time, just as it was with the transition from crafted ASM to higher level languages, the compilers became better, more efficient and trustworthy and I think the same will happen to LLMs, and we probably won't have to check the generated code as much, at least for most of the code around.
Is that a problem? Yes, for code that is intended to interface with humans (most of it still). The quality will probably become better and it won't be much of an issue.
Only problem is that, like a LLM, you don't retain anything.
Hobby projects may become a lot more important now because if you do them without LLMs you may retain a brain cell or two.
This will and is 100% happening. I have a friend who hasn't written code by hand in around a year, but uses LLMs every day, and he tells me he can't remember how to write code by hand anymore. He has been a developer for 10 years. But he's not working for anyone at the moment, so I imagine if he was in a workplace the circumstances would be different and they probably wouldn't settle for this.
I think that as a result of this it likely also atrophies the problem solving and architecture building skills that writing the code manually gives you. It just ends up degrading into a loop of tell the agent to do X and assume it knows what it is doing.
What's the risk here? Left behind by who or what?
> Or taking an “agent first” approach and trying to learn and improve more only on the side, as more of an afterthought?
This reads like anxiety resulting from FOMO.
Here's my take: I don't care about LLMs or AI in the sense that I don't feel any need or want to use them. I've only ever tinkered with the free ChatGPT. Never opened an account with any LLM vendor and never even considered it. I program by hand for the joy of it and sometimes for work. Still by hand as I have been doing. MY work gives me that luxury. For now.
Am I obsolete? Am I no longer of any value to society? Of course not. That thinking is just implanted by a group of money hungry individuals who don't give a fuck about me, you or society as a whole. So why would or should I care about LLMs?
Get some hobby projects.
I would still travel much less distance.
And just like cars, LLMs will reshape the world to the point that our brains could not even get us to the supermarket because soon it will be 5 miles away and require a car ( or at least a local LLM bike )
The point being that cars also reshape your perception of the world. METR had trouble replicating their dev productivity study because devs have already become much whinier about doing things "manually." Things that were slightly tedious in 2022 have become impossibly difficult without AI in 2026.
It is striking to reread Lord of the Rings: so much of the story is spent walking in and observing the Middle-Earth wilderness, and there is a distinct "pantheism" absent from the movies. JRR Tolkien, being one of the first modern fantasy writers, was one of the last who remembered a life without cars.
Used to think so, but they actually can also be used to train and strengthen skills, and learn new ones.
I had a coding interview, where they kindly sent a brief beforehand to help prepare, presenting a list of topics and concepts that might be useful during the interview, the tech stack, what kind of expectations they would have, and what they’d be paying attention to.
Obviously, it’s not exact list, and there are probably other evaluation dimensions.
But since I was out of practice on some of those, I had Claude generate a dozen sample projects, with each a list of tasks in one document and the solutions in another, and got to it.
Midway, I thought of using codex to role play as an interviewer, to tell it my train of thought and ideas as I went, get feedback, question my choices, etc.
Sure I only went through two and half, maybe three of those projects… but it’s the first time I actually enjoyed prepping for an interview. And I actually learned some things in the process.
Hardest part was probably stopping the LLM from doing the tasks, but nothing unsolvable given a bit more time, clearer instructions, and separation.
Can you clarify what this is supposed to mean?
At least that's what I thought of when I read that; because answering in place of other people is another thing I find annoying. So I'm speaking for myself, but with some optimism I may have guessed the intent of OP correctly :)
Master craftsmen didn't take on apprentices to give them chores.
Is today opposite day?
I don't want to be too flippant here, but senior engineers generally gain very little from training juniors, not least because promo processes suck at basically every tech firm, and so the moment you train up a junior, they are going to leap to another company rather than go through promo...
Yeah, that's the thing for me. LLMs have made my work easier and faster, and they've made my side projects easier and faster. I think there are very sensible and valid critiques but so far the tool works for me.
Saying agents produce shitty code is a bad argument though. They produce shitty codebase organization, but at a micro level their code is solid if not elegant. If you let them turn your codebase into a spaghetti mess, that's on you.
Ding ding ding. This is my biggest gripe with AI. Even the SEO blogspam, the fluff in front of every recipe, yarnwork or DIY instruction, it all was clearly written by a human. Someone had invested time (and money) in getting something in front of my eyes.
But now, it's all just slop. Everywhere. And hell I'm tired because the onslaught breaks my trust filters.
Maybe I think this is an age thing. Boomers? They trust everything written down somewhere. No matter what, and no matter if they didn't spend half my childhood to "never trust what people write on the Internet", and now they fall for scams left and right. My generation as said grew up with this "never trust, always verify" thing. And the younger generation? They DGAF about anything any more, all they care about is trying to survive.
> And b), the teaching, aka “How do we teach new people?”: previously, there was this balance aka “the junior does some pretty mundane tasks, but for this the senior reviews it together with him and helps him to grow”.
GOD YES YES YES THIS x1000.
There is barely anything more rewarding than teaching someone something, to watch the other person grow - and eventually surpassing your own abilities. That is when you know you did right and well. My wife is the best example, she started out at "can you help me with Excel", and these days, she pulls off stuff that would make more than a few finance people blush.
I think many junior devs (or aspiring junior devs) look for exactly this experience. This is a matching problem we haven't solved yet. Is Open Source the solution ? I really think it has to be solved if we want truely reliable software in the future.
The entire economy is broken due to the focus on short term quarterly result instead of the health of a company in 5, 10 or even 20 years.
It's really not incongruent to use LLMs and be in awe of their frankly incredible capabilities while at the same time recognize the risks and frankly real damage we are already seeing to junior training and hiring, open source communities and (in my opinion) very soon the entire fabric of our society.
I respect that people don't want to use agents themselves for whatever personal reason.
I respect maintainers not accepting AI-authored contributions. It's a tradeoff between progress, growing new contributors and maintainer sanity. Though I do feel that categoric opposition to anything AI will likely be futile in the mid-term.
I respect people pushing for regulation of AI or a global pause or whatever.
I don't particularly respect people dismissing everything AI authored as slop. Categorically refusing to read an article because it contains em-dashes or the term "load-bearing" is silly. While this is slowly changing now, many people are still in complete denial as to what the frontier AI is capable of.
Love it, hate it - I don't care, but at least respect it, goddamit.
Even this article has some cognitive dissonance in it. What it really comes down to is how much you trust your own verification process. The branches of questions an LLM generates are still trapped within the biases of its training data. Of course, the authority to craft that initial prompt, the very first question, comes from human experience and learning.
But I think thought itself is the easiest resource to outsource. People say the human did the thinking and the LLM just amplified it, but the truth is, the LLM outsources the thinking. Otherwise, when the result is good, people say "human thought was present," and when it's bad, they say "human thought was absent." But a part of the actual thinking really is outsourced. The alternatives, the counterexamples, the sentence structure. In programming terms, the reader's experience gets outsourced. When you write a blog post, you find yourself thinking about how to make something you understand easy for someone else to understand. With an LLM, that part gets outsourced.
But at the same time, I don't get the argument that you shouldn't use it at all. We don't "think" about everything. We have limited cognitive resources. So we study deeply the things we care about, but for the things we don't need, we mostly leave them to "common sense" or prejudice. We just skim the surface.
I think of "common sense" as "the largest collection of prejudice." Because what we call common sense usually just amounts to surface level knowledge, the kind of thing we know just enough about to get by.
That's why I think LLMs are good. The reason is simple. I don't think deeply about everything in the world anyway. For everything else, I'm buried in some kind of bias. You see it on HN all the time, right? People fight over some technology, but they often don't think about its internal structure or why it works the way it does. They just treat it as an identity. They fight over a particular language, a framework, an operating system, but they rarely check how that technology actually works internally or why it was designed that way. Why use MVC, why a different architecture might be better for my case, it's easier to just go with what's popular. Put more elegantly, "job mobility" gets bundled in there too. I use Windows. In my country, if it's not Windows, you literally can't do anything. You can't even do basic online banking. From regional context like that all the way down to personal interests, people are bound to be different. So I'm just going to use LLMs. The most common excuse you hear around this is the whole "reinventing the wheel" thing.
So yeah, I'm going to use LLMs. Because I recognize that I bias myself toward only thinking about what I want to think about. And I know that bias isn't cognitively healthy. But on the flip side, I think what the world values, whether it's knowing a lot or knowing one thing deeply, is going to change.
Honestly, I don't know what's right. I think both the advocates and the critics are making valid points. I respect the people who don't use it, and the people who do just have their own workflow. There's really no reason to fight over whose workflow is superior.
The tech world does not care about woke ideology, german technical illiteracy and self importance.
LLMs are useful and here to stay.
Im spending about 2-3K a week on personal projects and 5K a week on corporate stuff.
It's nice to see a person who actually acknowledges tradeoff.
For the curious, this seems to be his company: https://www.umh.app
It's not because LLMs are that efficient, it's because humans are that inefficient.
I'm saying it in jest, but it's also a bit true. Not necessarily because we use it any differently. But because my use of AI saves me time. But their use of AI adds more to my plate, no matter if it's slop or not.
The big thing people used to call AI was that it was a stochastic parrot and all it did was summarize things. Clearly. None of this is/was true anymore. And very likely all the current criticism will be eliminated soon and we have to find new excuses about AI that makes us feel we are superior.
The status quo is about to change. Every 6 months. And you will always think of yourself as superior to LLMs. Your current criticisms will evolve as most of them will be rendered not true pretty soon.
> "Yet I still write all of my texts with LLMs"
So I'm guessing the author is actually ok with the point they put in the "LLMs are bad" part of the article?
A smartphone is also a genuinely good all-around tool. Even social media is a genuinely good tool for connecting people.
Yet, I feel like we've been overly optimistic about the impact of said tools on us and our societies in the past two decades.
Smartphones are so good, in fact, in some societies, half of us are addicted to them. Billions of people world-wide.
I ask myself: Will LLMs enrich my thinking in the long run, or will they ruin it?
And what about most people? Will half of us outsource most of our thinking in a decade from now?
Given the speed and global scale that we're running these experiments with, it's fair, I think, to be a bit sceptical of the conclusion that, in the long run, LLMs will enrich our thinking.
LLMs are just continuing the trend humanity has long been traveling down.
You're using broadly shared but totally unsubstantiated about past humans just to argue that things are good right now.
In stone age, you had to focus on other things than thinking to have enough food for the next day. And to survive otherwise.
I use AI to code tools for myself, but I don't pretend anything I make is production quality. Duct tape engineering has always been a bit sloppy, and AI just made it faster.
I use AI to troubleshoot issues and plan out strategies, but I basically consider the AI draft of anything to be "draft 0", and use it as a framework for writing my own works for a real first draft of anything I write that will be read by other people. Sometimes the AI spits out a perfect paragraph that I might copy, but I don't ever blindly trust it or let it speak for me. I also double-check everything it says that I don't have existing knowledge of, rather than trust it to be right.
AI images, video, and music are all entertaining, but I only generate these things as a form of self-entertainment and maybe online meming. I could never in good conscience pass these creations off as my own, or publish them online on a personal or business website when something non-synthetic would suffice.
And I am never personally confiding in an LLM like it were a person. I have had it help me brainstorm options for office politics stuff, but I'm not about to ask it for relationship advice or to be my friend.
I do love that it accelerates the tedious stuff, and helps me learn new things pretty quickly if used right. It has definite utility. But I am always really distrustful of it. Sometimes at work we are asked to share how we use AI, and I have actually refused before, on the grounds that I may have found a useful way to use the AI, but I am worried that others will use my same method badly (e.g., not verifying eveything the AI says first), and I would rather not share.
It's like I have a finicky gun. I might be comfortable shooting it since I know its quirks and how to keep it from accidentally discharging, but I'm not loaning it out to anyone I wouldn't want to accidentally shoot themselves with it.
That seems unlikely given the diverse nature of mutually exclusive opinions that exist out there.
Critics seem to run the gamut from LLMs being incapable of even the most basic of functions to already sentient creatures secretly plotting our destruction with steganographic messages to each other.
It's maybe a bell curve with some wacky at those tails, but there's some fairly significant differences of opinion amongst the positions that are more mainstream.
Just the difference between critics of all LLMs and crutics of all closed weights models are a pretty big gap.
Similarly for those who criticise them for over censorship vs those who criticise them for unrestricted generation.
It's sad that this can be true because if you did them alone the quality would be non-existent.