Speculative Decoding: The Free Speed Toggle Your Local LLM Is Probably Not Using (vettedconsumer.com) 4 points by ermantrout 3mo ago ↗ HN
0 comments
[ 2.6 ms ] story [ 10.9 ms ] threadNo comments yet.