[–] 44za12 7mo ago ↗ For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.
1 comment
[ 0.29 ms ] story [ 23.3 ms ] thread