The first framework that can post train DeepSeek V4-pro on a single-node?

3 points by timxzz ↗ HN
Hi all,

We just opensourced a project called Orbit, which can RL post train trillion scale LLMs like deepseek v4. We found it pretty cool! Looking forward to some comments!

- Tim

Blog post:

https://spherelab.ai/orbit/

3 comments

[ 1.9 ms ] story [ 12.4 ms ] thread
This is so good. Is it kinda similar in concept to QLoRA training?