New SOTA 4-bit weight and KV quantization with optimized GPU performance (arxiv.org) 3 points by Hugsun 2y ago ↗ HN
0 comments
[ 5.0 ms ] story [ 10.4 ms ] threadNo comments yet.