2 comments

[ 2.9 ms ] story [ 17.1 ms ] thread
General-Purpose Cyber Benchmark for AI Agents and their Models
I'm wondering why they have decided to airgap the models inside docker containers. IMO, this would have been a better comparison if the models were allowed to perform tool calls.