Why LLM decode is memory-bound, not compute-bound (github.com) 5 points by harshuljain13 3mo ago ↗ HN
1 comment
[ 4.0 ms ] story [ 16.1 ms ] thread