Speculative Decoding: The Free Speed Toggle Your Local LLM Is Probably Not Using (vettedconsumer.com) 4 points by ermantrout 1mo ago ↗ HN
0 comments
[ 2.9 ms ] story [ 12.9 ms ] threadNo comments yet.