MMLU-Pro: Advanced edition of MMLU & new Leaderboard (huggingface.co) 1 points by nopinsight 2y ago ↗ HN
[–] nopinsight 2y ago ↗ A summary of how it was created and leaderboard screenshot (by an author I presume):https://twitter.com/WenhuChen/status/1790597967319007564Part of the tweet: "We found that GPT-4o (71%) actually improves GPT-4-turbo (62%) by 9%! On the original MMLU, the improvement is only around 2%."
1 comment
[ 7.5 ms ] story [ 47.0 ms ] threadhttps://twitter.com/WenhuChen/status/1790597967319007564
Part of the tweet: "We found that GPT-4o (71%) actually improves GPT-4-turbo (62%) by 9%! On the original MMLU, the improvement is only around 2%."