CLLMs: LLMs can be taught to parallel decode with up to 3.5x speedup (twitter.com) 3 points by snyhlxde 2y ago ↗ HN
0 comments
[ 3.3 ms ] story [ 10.7 ms ] threadNo comments yet.