OpenAI o1-preview is SOTA on the aider leaderboard (aider.chat)

1 comment

[ 2.9 ms ] story [ 14.2 ms ] thread

OpenAI o1-preview is SOTA at 79.7% on the aider code editing leaderboard, with "whole" edit format. With the practical "diff" format, it ranks between GPT-4o & Sonnet.

  80% o1-preview whole
  77% Sonnet diff
  75% o1-preview diff
  75% Sonnet whole
  71% GPT-4o diff