I have discussed this already, and was referred to solutions like Agno or Google SDK or other libraries. But there I don't find anything that makes me think "this is better than just having 4 terminals splitted in my pc and toggling between them".
The reason there’s no good orchestration layer above the base model is that the useful part of orchestration moved into the model. what’s left to bolt on top is negative value when token consumption, latency and usability are factored in.
I’ve spent a great deal of time trying to beat plain Claude Code and Codex with a variety of planner/critic/decomposition orchestration setups. Every one produces less or same quality, 2x+ tokens, more latency and a second system to debug. External orchestration seems like I’m just creating technical debt and the actual value is focusing exclusively on providing clearer specifications (ie statements of intent, constraints and input/output contracts) to the model and just letting the leading frontier model do its thing with reasoning and effort maxed out.
Ironically the real orchestration benefit is on the human side refining intent to model instead of orchestrator to agent, invoking AskUserQuestion and other tools for the model to more deeply disambiguate my requests.
4 comments
[ 2.0 ms ] story [ 24.2 ms ] threadI’ve spent a great deal of time trying to beat plain Claude Code and Codex with a variety of planner/critic/decomposition orchestration setups. Every one produces less or same quality, 2x+ tokens, more latency and a second system to debug. External orchestration seems like I’m just creating technical debt and the actual value is focusing exclusively on providing clearer specifications (ie statements of intent, constraints and input/output contracts) to the model and just letting the leading frontier model do its thing with reasoning and effort maxed out.
Ironically the real orchestration benefit is on the human side refining intent to model instead of orchestrator to agent, invoking AskUserQuestion and other tools for the model to more deeply disambiguate my requests.