Show HN: I made a small helper for checking model-graded answers (github.com)
I made this while checking model graded answer and helped me to check the odd cases by hand. Not sure if it’s useful to anyone else.
TL;DR: it breaks an LLM judge run into claims->evidence->verdicts and flags when a verdict is not supported by the evidence, so i can check it manually.
0 comments
[ 1.8 ms ] story [ 6.6 ms ] threadNo comments yet.