1 comment

[ 0.22 ms ] story [ 8.9 ms ] thread
The most overlooked event of the year started in late August and is running as you read this: the Marin project out of Stanford is pretraining a 535-billion-parameter model with every metric streaming to the public in real time. It's the largest fully open, live-streamed frontier training run anyone has ever attempted.