67% Cost Savings with PD Disaggregation Using Ray and vLLM on AMD MI325X (anyscale.com) 4 points by robertnishihara 29d ago ↗ HN
0 comments
[ 2.7 ms ] story [ 11.7 ms ] threadNo comments yet.