Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, VLLM) (lmsys.org) 4 points by yvbbrjdr 2y ago ↗ HN
0 comments
[ 3.8 ms ] story [ 11.9 ms ] threadNo comments yet.