2 comments

[ 3.0 ms ] story [ 17.2 ms ] thread
Some of the authors are available to discuss the current code or the roadmap.
Some interesting notes about the project if folks want to dig deeper:

There is a dev mode that runs on a laptop:

  - https://docs.cray-lm.com/deployment/laptop
There is a unified dockerfile for building vLLM and the training stacks on four targets [ROCm, CUDA, ARM, x86]

  - https://github.com/cray-lm/cray-lm/blob/main/Dockerfile