Prompt caching but for RL – 7.5x speedup on long-prompt/short-response workloads (castform.com) 4 points by kumama 2mo ago ↗ HN
0 comments
[ 2.8 ms ] story [ 8.5 ms ] threadNo comments yet.