1 comment

[ 0.20 ms ] story [ 10.9 ms ] thread
I like this benchmark because the adversarial nature of the underlying language helps judge a model's ability to remain productive despite miscommunication and imprecision, which we'll reflects the nature of real work.