Cutting LLM inference costs by 36% with prompt caching (neradot.com) 1 points by lizakatz 2mo ago ↗ HN
1 comment
[ 7.1 ms ] story [ 48.9 ms ] thread