SambaNova Cloud Launches the Fastest DeepSeek-R1 671B (198 tok/s) (sambanova.ai)

5 points by mzl 1y ago ↗ HN

2 comments

[ 4.3 ms ] story [ 17.8 ms ] thread

The smaller cluster is not necessarily a good thing. It may not be able to take advantage of unbalanced load on experts.

bn-l 1y ago ↗

Yeah and zero open api. This is just a fluff piece.