PFlash: 10x prefill speedup over llama.cpp at 128K on a RTX 3090 (github.com) 3 points by GreenGames 6mo ago ↗ HN
2 comments
[ 4.3 ms ] story [ 22.9 ms ] thread