Speculative KV coding: ~4× losslessly compressed KV cache using a small model (fergusfinn.com) 2 points by somnial 4mo ago ↗ HN
0 comments
[ 5.4 ms ] story [ 14.6 ms ] threadNo comments yet.