HN Explorer

Ask HN: How to get the most intelligence out of your agents?

1 points by thechairman12 ↗ HN
I often find chatgpt.com has greater "intelligence" than codex.

I've found this to be true for the past year or two now, and I was wondering if anyone has found a better solution than copying context to and from chatgpt.com. The "Pro" level (or whatever the max level is at the time) consistently has better insights than the agent, but immensely limited tool calling compared to the agent. Marrying the two of these together unlocks a lot of potential, but I really just want this intelligence to live on my laptop, instead of me being the intermediary.

24 comments

[ 0.18 ms ] story [ 10.7 ms ] thread
verdverm
Someone once said, "give your agents good tools and context" and get out of the way. I would add, "stay in the loop friends"
qwerpy
This is good advice and I wish I had read it before today. I use the state of the art model (Opus 5.5) and telling it with words how to interact with my issue tracker and my repo still doesn’t work. Mostly because of its overly restrictive auto-mode guardrails and brittle command whitelisting, but also a lot of “oops, I didn’t read the doc that you clearly tell me to read at the top of agents.md, I’ll make an ineffective note so this never happens again (it keeps happening)” The solution I’m using now is various scripts that encapsulate almost everything the agents usually need to do and just whitelist those.
verdverm
I've been working on our custom PR agent at work. The agent phase is minimal, read-only/no bash (except for the .review dir). Most of the effort is in deterministic context gathering with scripts (before), and then posting the lines from a comments.jsonl file (after). I do have to work a something back into the agent phase, such that it can validate the comments.jsonl, because it seems to be generating bad payloads.

It's an iterative take-give, take away as much as you can so the bot can focus on the core task, then give some back to improve the agent output as you find repeated mistakes.

thechairman12
I've been working on building up my AGENTS.md file over time. It has certainly improved things. My core point is that even without these advantages, chatgpt.com provides deeper insights with their $200/mo ai...

Something is up.

mickeyp
One thing you can try is to build specialised subagents to help tease out more thinking when you're stuck with a model with limited reasoning budget as all the codex sub models seem to be (compared to API) --- but I have no firm, hard evidence of this so treat it as guesswork on my part.

Let me explain.

Creat a subagent that is told to just mull about a subject. This can be a simple file.

Have the agent expound on it with its own thoughts and additions.

Now rinse and repeat: give the file to another blank 'reasoning' subagent; then another; and so on.

This will eventually reach a point where they are unlikely to add more real value.

I believe they've locked down temperature and other sampling parameters so you cannot tweak these to get it to consider more unusual approaches.

The absolute best approach is a second model that is of a different family. Try Deepseek, GLM, Qwen, etc. and have it add its own thoughts. As a bonus, these models do not hide their reasoning. Put that in a file also.

thechairman12
Thanks for the response! I like the idea of pitting the various model families against eachother.

A bit token expensive, though. Especially when it isn't part of the subscription.

verdverm
start with a $10/m OpenCode Go plan, get yourself a gateway like GoModel and put all your credentials there, and then use a vendor neutral harness like OpenCode (because the big labs are not interested in supporting other model families than their own, they hold you down for the sake of their profits)
speedwayus
I made a shared memory that put memories related to the conversation and topic in each turn with hooks in claude code, that way my agents always have frees memories, no matter if im in claude, cursor or grok, it always remember my stuff
rzk
Care to share your setup?
heylittlepan
Just tell codex to do the copy/paste for you. Stay logged in to chatgpt site and it'll figure out the rest like any other site. Also the web side has its own usage limits ;)
melbeesgames
3 points: 1. Organize your repository/project: separate specs, plans, runbooks, code, config/settings, data, ... and architecture. Each with an index generated by a deterministic tool.

2. Define the standard architecture and don't let agents deviate from it without your approval. Also with deterministic control.

3. Use different models to validate the plan and then the code. If model A creates the plan/code, use model B to review it.

4lx87
In case you're not aware, Codex lets you set the reasoning effort in the model picker or with codex --config 'model_reasoning_effort="high"'.
abalgir
I have found that building a strict pipeline (custom dev) around the agents helps keep them honest and focused. But it's complex development; the agent model and effort don't guarantee good results. For now, having multiple agents from different companies check each other and the surrounding code is the best way to ensure excellent results.
gbroeckling
They all have their place, and it changes every few weeks
rainymoon
At the beginning of any project, try to ask as many questions as possible. In the later stages, try to have multiple agents communicate with each other to solve the problem independently.