GPT-4o tops the aider LLM code editing leaderboard at 72.9%, versus 68.4% for Opus. GPT-4o takes second on aider’s refactoring leaderboard with 62.9%, versus Opus at 72.3%.
GPT-4o did much better than the 4-turbo models, and seems much less lazy.
GPT-4o is also able to use aider’s established “diff” edit format that uses SEARCH/REPLACE blocks. This diff format is used by all the other capable models, including Opus and the original GPT-4 models The GPT-4 Turbo models have all required the “udiff” edit format, due to their tendancy to lazy coding.
1 comment
[ 3.9 ms ] story [ 15.9 ms ] threadGPT-4o did much better than the 4-turbo models, and seems much less lazy.
GPT-4o is also able to use aider’s established “diff” edit format that uses SEARCH/REPLACE blocks. This diff format is used by all the other capable models, including Opus and the original GPT-4 models The GPT-4 Turbo models have all required the “udiff” edit format, due to their tendancy to lazy coding.