1 comment

[ 2.7 ms ] story [ 15.5 ms ] thread
For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.