Promptbench: A Unified Library for Evaluating and Understanding LLMs (github.com) 1 points by Flux159 2y ago ↗ HN
[–] Flux159 2y ago ↗ Some results published here https://llm-eval.github.io/pages/leaderboard/advprompt.htmlAlso, technical report on arxiv https://arxiv.org/abs/2312.07910I think that something that would make the results better would be highlighting which models perform best for specific tests (ie color coding) and explaining the tests via some hover info.Also with some fine tuned models training to get higher scores on specific tests, I don't know how valuable these tests are in comparison to chatbot arena's elo ranking https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...
1 comment
[ 4.4 ms ] story [ 10.9 ms ] threadAlso, technical report on arxiv https://arxiv.org/abs/2312.07910
I think that something that would make the results better would be highlighting which models perform best for specific tests (ie color coding) and explaining the tests via some hover info.
Also with some fine tuned models training to get higher scores on specific tests, I don't know how valuable these tests are in comparison to chatbot arena's elo ranking https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...