Ask HN: What are some good benchmarks for different agent harnesses? 3 points by Bnjoroge 23d ago ↗ HN Other than terminal bench which doesnt quite map to my experience, what are some other benchmarks to see how different models do in different harnesses?
[–] drewbitt 23d ago ↗ These all track harnesseshttps://www.vals.ai/benchmarks/vibe-codehttps://www.vals.ai/benchmarks/swebenchhttps://www.vals.ai/benchmarks/terminal-bench-2-1 (vals customized terminal bench 2.0)https://artificialanalysis.ai/agents/coding-agents
1 comment
[ 2.9 ms ] story [ 12.7 ms ] threadhttps://www.vals.ai/benchmarks/vibe-code
https://www.vals.ai/benchmarks/swebench
https://www.vals.ai/benchmarks/terminal-bench-2-1 (vals customized terminal bench 2.0)
https://artificialanalysis.ai/agents/coding-agents