16-Bit to 1-Bit: Visual KV Cache Quantization for Efficient Multimodal LLMs (arxiv.org) 87 points by PaulHoule 1y ago ↗ HN
5 comments
[ 2.9 ms ] story [ 23.6 ms ] thread