Prompt caching but for RL – 7.5x speedup on long-prompt/short-response workloads (castform.com) 4 points by kumama 4mo ago ↗ HN
0 comments
[ 1.2 ms ] story [ 33.1 ms ] threadNo comments yet.