[–] cloudie78 28d ago ↗ I might be dumb, can someone explain to me how these are supposed to be useful? What if I want to tackle one of these myself, manually?I expand the sections and it’s all full of prompt slop [–] onnies 28d ago ↗ This benchmark measures an agents ability to solve SRE/On-call tasks!Which expanded sections are slop? Happy to point you in the right direction - we also have a github repo: https://github.com/abundant-ai/incident-arenawhich has the tasks in harbor format (instruction.md files etc)
[–] onnies 28d ago ↗ This benchmark measures an agents ability to solve SRE/On-call tasks!Which expanded sections are slop? Happy to point you in the right direction - we also have a github repo: https://github.com/abundant-ai/incident-arenawhich has the tasks in harbor format (instruction.md files etc)
2 comments
[ 2.7 ms ] story [ 42.1 ms ] threadI expand the sections and it’s all full of prompt slop
Which expanded sections are slop? Happy to point you in the right direction - we also have a github repo: https://github.com/abundant-ai/incident-arena
which has the tasks in harbor format (instruction.md files etc)