Ask HN: What are the things LLM models fail at?

1 points by aqua_coder ↗ HN
Generally, whenever I do see frontier AI model's evaluation metrics on say Artificial Analysis. It gives out a benchmark on a set of questions (or tasks). But it never quite actually shows what tasks it fails at. I'm more curious on benchmarks that focus on SWE.

0 comments

[ 0.21 ms ] story [ 8.2 ms ] thread

No comments yet.