16-Bit to 1-Bit: Visual KV Cache Quantization for Efficient Multimodal LLMs (arxiv.org) 87 points by PaulHoule 1y ago ↗ HN
5 comments
[ 3.0 ms ] story [ 23.2 ms ] thread