QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (SOTA sub-4-bit inference) (arxiv.org) 1 points by Hugsun 2y ago ↗ HN
0 comments
[ 4.6 ms ] story [ 15.7 ms ] threadNo comments yet.