Show HN: Jevals – replacing LLM judges with typed Jev decisions (github.com) 4 points by gbayomi 1mo ago ↗ HN
[–] adityamishra241 1mo ago ↗ Interesting idea. How do you handle cases where the decision depends on context that isn't captured by the typed decision type? [–] gbayomi 1mo ago ↗ It’s very dependent on the underlying model right now, but it performs well for the current versions of jev/keV/laya!
[–] gbayomi 1mo ago ↗ It’s very dependent on the underlying model right now, but it performs well for the current versions of jev/keV/laya!
[–] jacksun788 1mo ago ↗ Curious — how's this compare to laya? [–] gbayomi 1mo ago ↗ It can also run with laya. The idea is to have an easy way to run common evals with decision models and easily switch the “backend” from jev/kev/laya etc
[–] gbayomi 1mo ago ↗ It can also run with laya. The idea is to have an easy way to run common evals with decision models and easily switch the “backend” from jev/kev/laya etc
6 comments
[ 73.4 ms ] story [ 110 ms ] thread