Speculative KV coding: ~4× losslessly compressed KV cache using a small model (fergusfinn.com) 2 points by somnial 2mo ago ↗ HN
0 comments
[ 3.1 ms ] story [ 8.1 ms ] threadNo comments yet.