Why LLM decode is memory-bound, not compute-bound (github.com) 5 points by harshuljain13 1mo ago ↗ HN
1 comment
[ 0.23 ms ] story [ 14.3 ms ] thread