Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, VLLM) (lmsys.org) 4 points by yvbbrjdr 1y ago ↗ HN
0 comments
[ 3.1 ms ] story [ 11.1 ms ] threadNo comments yet.