[–] 44za12 5mo ago ↗ For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.
1 comment
[ 2.7 ms ] story [ 15.5 ms ] thread