Faster LLM Inference: Lamini Inference with 52x more RPM than vLLM (lamini.ai) 1 points by dpflan 2y ago ↗ HN
1 comment
[ 1912 ms ] story [ 541 ms ] thread