[–] anotherpaulg 2y ago ↗ OpenAI o1-preview is SOTA at 79.7% on the aider code editing leaderboard, with "whole" edit format. With the practical "diff" format, it ranks between GPT-4o & Sonnet. 80% o1-preview whole 77% Sonnet diff 75% o1-preview diff 75% Sonnet whole 71% GPT-4o diff
1 comment
[ 302 ms ] story [ 1011 ms ] thread