Show HN: I built a small audit layer for LLM-as-judge decisions (github.com)

2 points by ML0037 ↗ HN
I made this while checking model graded answer and helped me to check the odd cases by hand. Not sure if it’s useful to anyone else.

TL;DR: it breaks an LLM judge run into claims->evidence->verdicts and flags when a verdict is not supported by the evidence, so i can check it manually.

0 comments

[ 3.7 ms ] story [ 8.3 ms ] thread

No comments yet.