Faster LLM Inference: Lamini Inference with 52x more RPM than vLLM (lamini.ai) 1 points by dpflan 2y ago ↗ HN
1 comment
[ 4.1 ms ] story [ 15.8 ms ] thread