Tide: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference (arxiv.org) 3 points by OsamaJaber 2mo ago ↗ HN
1 comment
[ 3.3 ms ] story [ 11.1 ms ] thread