Craylm: Open-source unified LLM training and inference for R1 (blog.cray-lm.com) 9 points by gdiamos 1y ago ↗ HN
[–] gdiamos 1y ago ↗ Some interesting notes about the project if folks want to dig deeper:There is a dev mode that runs on a laptop: - https://docs.cray-lm.com/deployment/laptop There is a unified dockerfile for building vLLM and the training stacks on four targets [ROCm, CUDA, ARM, x86] - https://github.com/cray-lm/cray-lm/blob/main/Dockerfile
2 comments
[ 3.0 ms ] story [ 17.2 ms ] threadThere is a dev mode that runs on a laptop:
There is a unified dockerfile for building vLLM and the training stacks on four targets [ROCm, CUDA, ARM, x86]