GSD-LQ: Zero-calibration sub-4-bit compression and 7B in 3.78 GB VRAM (github.com) 1 points by Phantom309-CED 5d ago ↗ HN
1 comment
[ 0.20 ms ] story [ 9.8 ms ] thread