Is AI slowing you down?
I am genuinely curious about this question and want to understand people's experiences. I'm a principal engineer with decades of experience, I am currently working on a massive codebase that does RPA (data entry automation for old software). I can get my agents to build complex features from scratch, However, if I don't describe exactly how it needs to be built (low level specs), or if I don't know how the current codebase needs to be updated to support this change things quickly get out of control. So in other words, if I trust the agents to make any design decisions on their own, then a lot of nuance will be completely missed, leading to major bugs or issues with the SLA.
To summarize my problem, I am finding that the work required to build detailed enough specs, review and evaluate AI changes is far more time consuming (and cognitively demanding) than implementing the features myself.
Where am I going wrong?
17 comments
[ 0.27 ms ] story [ 27.0 ms ] threadAnd then get it to review the code, where it'll pickup a few edge cases.
But I don't really get the attitude that we shouldn't write code anymore, for me it's often quicker to write the code than to explain to the AI how to write it.
Sometimes when I'm.sitting there watching it chug away for 5 minutes over what should be a three line change, I'll just stop it and do it myself, and then at that point I'll often take over completely for a while.
With vibe-coding you get huge productivity (10x) but bad quality
Manual coding its 1x productivity but good quality
I land closer to the manual coding side with agents, its more productive but I do have to heavily micromanage them
I would guess around 1.3-1.5x productivity
Where I get slowed down by AI is when working with others. My current main gig is one of the places where they are pushing everyone to use AI for everything, and tying compensation to how much you use it. So people have stopped talking - they paste AI responses back and forth at each other. It is bizarre, dysfunctional, and dystopian, and I am so looking forward to the end of this contract.
First thing we do is to map out an existing codebase (or a piece of a codebase if it's a monorepo). We have the models synthesize what's in there and document the architecture AND the intent of the app (retroactively building a PRD based on codebase). We use n-dx for this and it has worked very well. There's still bugs and plenty of improvements to be made with the tool (n-dx), but it's open-source so it's easy to make improvements whenever it falls short during a set of tasks
The problem with legacy systems is that the low-level details are the requirements. Things that look like implementation details often encode 20 years of business rules.
An AI agent doesn't know which weird-looking piece of code is accidental complexity and which weird-looking piece of code is keeping a $10M customer from breaking.
So I don't think the answer is necessarily to give the agent higher-level instructions. Sometimes the answer is to give it less autonomy.
I've had AI slow me down twice.
Once, it was just failing to build simple flows for complex business logic getting added to existing complex business logic. It was more efficient for me to just spend a few hours and handcode it to get clean code.
Second time is partially my fault. I had a spec with about 10 stages. I let it run stage 1 and it got overzealous and finished the project. Reviewing, tweaking, and testing the massive change took me several days. I should have just wiped it and started over. It would have been much faster. I had maxed out my weekly usage already so I didn't want to redo it.