SqueezeLLM: Dense-and-Sparse Quantization (arxiv.org)

1 comment

[ 2.5 ms ] story [ 11.5 ms ] thread

I dunno why this was passed by HN. Those results are fantastic.