4 comments

[ 261 ms ] story [ 1266 ms ] thread
Welcome to the future. I think open weight models are our only hope for LLMs being net positive for society.
To anyone who is unfamiliar with LM Arena, this isn't a synthetic benchmark but basically an A/B test.

Human users submit the same prompt to two models and then pick with output they prefer.

Also very good for free image gen, for what it's worth. You just enter the same prompt 4 or 5 times and eventually it goes to a good model.

I wish we could stream active data to RAM, directly from the NVMe drive for the 2TB K3 model. Can't wait for prism-ml/ to release a ternary 2bit model, which would make this a bit more tenable.
1 bit would be cool!