Author here. I had two goals:
1. try out Orca for running a team of coding agents
2. See how Pi, a minimal open-source agent, generates codes against a popular one like Codex.
So I ran the same small team (spec, design, build, with a shared reviewer) twice in Orca. Once on Codex with GPT-5.6. The other on Pi with GLM-5.3. Both built chess coach apps. Then I let their chess coaches compete.
Codex finished faster, but Pi's engine beat Codex's with 19-1 times.
1 comment
[ 0.26 ms ] story [ 6.5 ms ] threadSo I ran the same small team (spec, design, build, with a shared reviewer) twice in Orca. Once on Codex with GPT-5.6. The other on Pi with GLM-5.3. Both built chess coach apps. Then I let their chess coaches compete. Codex finished faster, but Pi's engine beat Codex's with 19-1 times.
Prompts, both apps, tests, judging and match logs are in the repo: https://github.com/piscaries/codex-vs-pi-in-orca
Happy to answer questions about the setup.