zhye

↗ HN profile [ 22.5 ms ] full profile

Karma: 3
Created: May 29, 2023 (3y ago)
Submissions: 0

Cascade Inference: Memory Bandwidth Efficient Shared Prefix Batch Decoding (flashinfer.ai)

2 points 2y ago 0