Gemma 4 on Cerebras - The Fastest Inference Is Now Multimodal (cerebras.ai) 24 points by Tiberium 2mo ago ↗ HN
[–] tmanchester 2mo ago ↗ Okay this is actually pretty cool. Gemma 4 is a nice little model and I've really enjoyed playing around with it. At 1800 tok/s turns are essentially instant, it's a bit of a trip
[–] simianwords 2mo ago ↗ I just tried it on their website and it is extremely fast. I wonder what is the value prop of this? Where would I want1. a smaller model2. also non local, hosted on cloudI can't think of any case. [–] [dead] keynha 2mo ago ↗ [dead]
4 comments
[ 4.3 ms ] story [ 27.8 ms ] thread1. a smaller model
2. also non local, hosted on cloud
I can't think of any case.