Show HN: Streaming Structured Output Is Still Broken (schnabl.cx)
Structured output has become a de facto expectation for LLM APIs, but streaming that structured output is still a mess. A big miss, streaming partial results in parallel can nearly double agent throughput.
OpenAI, Anthropic, and Gemini handle streaming structured responses, but each breaks developer expectations differently: missing parsed results, losing final token stats, or adding unnecessary boilerplate.
0 comments
[ 1.9 ms ] story [ 7.7 ms ] threadNo comments yet.