SonicBoom – llama.cpp's own kernels, 14% faster decode via a graph compiler (github.com) 1 points by nalaginrut 21d ago ↗ HN
0 comments
[ 18.6 ms ] story [ 163 ms ] threadNo comments yet.