KVComp: A High-Performance, LLM-Aware, Lossy Compression Framework for KV Cache (arxiv.org) 3 points by kstonekuan 1y ago ↗ HN
0 comments
[ 4.6 ms ] story [ 11.3 ms ] threadNo comments yet.