Fastest JSON Decoding for Local LLMs with Compressed Finite State Machine (lmsys.org) 2 points by MMMercy2 2y ago ↗ HN
0 comments
[ 4.6 ms ] story [ 12.5 ms ] threadNo comments yet.