One thing we found interesting is that Clojure's benchmark-wide performance was nuked by Anthropic models, whereas OpenAI and many other frontier lab releases reasoned quite well in Clojure.
The individual language per-model data is noisy, but aggregated per-provider data gives an interesting view of how companies are training their models. Data at https://gertlabs.com/rankings?mode=agentic_coding
1 comment
[ 2.9 ms ] story [ 10.2 ms ] threadThe individual language per-model data is noisy, but aggregated per-provider data gives an interesting view of how companies are training their models. Data at https://gertlabs.com/rankings?mode=agentic_coding