HN Explorer

New open sourced eval tool for building agents

2 points by Thomeras ↗ HN
Hello so i created agent detective tool, this tool answer question: which of the agents broke in system/workflow. I would really appreciate if community would try it out. https://github.com/Thomeras/agent_detective

1 comment of 3

[ 10.3 ms ] story [ 70.7 ms ] thread
mmakeev
how do you define quality broke? for me it broke when nothing broke. score from llm moved, >= 4 filter after it meant something else. gating on exit code would have passed the whole time.