Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving (github.com) 8 points by sarkory 1y ago ↗ HN
1 comment
[ 1.6 ms ] story [ 20.0 ms ] thread