Show HN: We built an AI Agent to reproduce bugs (metabase.com)

12 points by nvoxland 3mo ago ↗ HN

At Metabase, we built an AI agent called Repro-Bot that reads our GitHub issues and attempts to reproduce reported bugs automatically.

It started as a hackathon project and is now part of our daily workflow, so we wrote about it and open-sourced the code as an example for others.

How have similar tools been working for you? What has worked well and what has not?

2 comments

[ 3.0 ms ] story [ 14.6 ms ] thread

CDDev 3mo ago ↗

It is good to see AI agents are used outside of client apps and I really appreciate the idea behind it. What's your false-positive rate like cases where the bot "reproduces" something but actually hits a different bug, or confirms a non-bug as reproduced? How you validate the agent's own confidence.

[deleted] 3mo ago ↗

(comment deleted)