New SOTA 4-bit weight and KV quantization with optimized GPU performance (arxiv.org) 3 points by Hugsun 2y ago ↗ HN
0 comments
[ 2.8 ms ] story [ 11.2 ms ] threadNo comments yet.