3 comments

[ 1.6 ms ] story [ 18.5 ms ] thread
32 bits vs 4 bits it looks like
Yup, and unlike the original turboquant paper, my implementation is pinned to using a 4 bit code book so I could use SIMD kernels for performance.