Run 125B+ MoE on consumer GPUs (stratallm.org)

1 points by DerDerDaIst 1d ago ↗ HN

4 comments

[ 9.7 ms ] story [ 690 ms ] thread

DerDerDaIst 1d ago ↗

amazing first results on our local macstudio based setup.

jaggs 1d ago ↗

Is this linked to the original strata project?

[dead] rory18439909614 1d ago ↗

[dead]

[dead] diabolic1 1d ago ↗

[dead]