LLM-D: Kubernetes-Native Distributed Inference at Scale (github.com)

Comments moved thither. Thanks!