MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving (hao-ai-lab.github.io) 2 points by zhisbug 2y ago ↗ HN
2 comments
[ 3.4 ms ] story [ 18.5 ms ] thread