QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (SOTA sub-4-bit inference) (arxiv.org) 1 points by Hugsun 2y ago ↗ HN
0 comments
[ 4.5 ms ] story [ 13.2 ms ] threadNo comments yet.