Nvidia Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context (developer.nvidia.com) 1 points by frozenport 20d ago ↗ HN
[–] 2001zhaozhao 20d ago ↗ Gemma 31B dense at 3k TPS seems like a pretty big deal. Groq has always been more efficient than Cerebras at running very small models and this release seems to be no exception.
1 comment
[ 0.29 ms ] story [ 10.5 ms ] thread