3 comments

[ 10.8 ms ] story [ 37.4 ms ] thread
LiLiCorr spec decode + Mamba blocks seem really interesting for the speed up.