Show HN: Meta-agent: self-improving agent harnesses from live traces (github.com)
We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces.
Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set.
An LLM judge scores unlabeled production traces as they stream.
A proposer reads failed traces and writes one targeted harness update at a time, such as changes to prompts, hooks, tools, or subagents. The update is kept only if it improves holdout accuracy.
On tau-bench v3 airline, meta-agent improved holdout accuracy from 67% to 87%.
We open-sourced meta-agent. It currently supports Claude Agent SDK, with more frameworks coming soon.
Try it here: https://github.com/canvas-org/meta-agent
0 comments
[ 0.21 ms ] story [ 164 ms ] threadNo comments yet.