Show HN: We built an AI Agent to reproduce bugs (metabase.com)

12 points by nvoxland 5mo ago ↗ HN

At Metabase, we built an AI agent called Repro-Bot that reads our GitHub issues and attempts to reproduce reported bugs automatically.

It started as a hackathon project and is now part of our daily workflow, so we wrote about it and open-sourced the code as an example for others.

How have similar tools been working for you? What has worked well and what has not?

2 comments

[ 3.1 ms ] story [ 17.8 ms ] thread

CDDev 5mo ago ↗

It is good to see AI agents are used outside of client apps and I really appreciate the idea behind it. What's your false-positive rate like cases where the bot "reproduces" something but actually hits a different bug, or confirms a non-bug as reproduced? How you validate the agent's own confidence.

[deleted] 5mo ago ↗

(comment deleted)