SINQ was created last year. It was for weights only and it was calibration-free quantization. Then KVarN is for KV-cache quantization to get longer context. MACaQ is multimodal, activation and weights calibrated…
There's also an official project page https://huawei-csl.com/blog/macaq/ Worth checking out beyond the GitHub
Weird name. But looks like it. Their blog even says “So easy to use, even a macaque could get the hang of it.” (source: https://huawei-csl.com/blog/macaq/ )
SINQ was created last year. It was for weights only and it was calibration-free quantization. Then KVarN is for KV-cache quantization to get longer context. MACaQ is multimodal, activation and weights calibrated…
There's also an official project page https://huawei-csl.com/blog/macaq/ Worth checking out beyond the GitHub
Weird name. But looks like it. Their blog even says “So easy to use, even a macaque could get the hang of it.” (source: https://huawei-csl.com/blog/macaq/ )