Grok Weights Available via Torrent (twitter.com)

They made good on their promise it would seem.

Bold to make a joke about the tsunami of spam overrunning the site.

As promised, weights are available. For those who don't like Twitter / X, Here are the details from the README:

- 314B parameter Mixture of Experts model

- Base model (not finetuned)

- 8 experts (2 active)

- 86B active parameters

- Apache 2.0 license

- Code: https://github.com/xai-org/grok

- Weights: https://github.com/xai-org/grok?tab=readme-ov-file#downloadi...

Even more open than OpenAI.

It's a 314 billion parameter mixture-of-experts, apparently trained using a custom framework using Rust and Jax.

Some more discussion: https://news.ycombinator.com/item?id=39737281