Hey HN! We've built this platform that allows you to evaluate how well your LLM implementation is performing, despite that be using open source tools such as LangChain, lLamaIndex, or even your own internal framework.
The idea is you would use our open source package (https://github.com/confident-ai/deepeval) to evaluate LLM outputs using criteria such as factual consistency, relevancy, bias, etc, and be able to have a bird eye's view on the overall performance on app.confident-ai.com as our package allows you to run analysis on our servers, all for free!
Would appreciate it if you could give it a try, thanks :)
1 comment
[ 3.8 ms ] story [ 13.7 ms ] threadThe idea is you would use our open source package (https://github.com/confident-ai/deepeval) to evaluate LLM outputs using criteria such as factual consistency, relevancy, bias, etc, and be able to have a bird eye's view on the overall performance on app.confident-ai.com as our package allows you to run analysis on our servers, all for free!
Would appreciate it if you could give it a try, thanks :)