16-Bit to 1-Bit: Visual KV Cache Quantization for Efficient Multimodal LLMs (arxiv.org) 87 points by PaulHoule 1y ago ↗ HN
5 comments
[ 3.9 ms ] story [ 18.7 ms ] thread