Running Laguna S 2.1 locally on Apple Silicon: 52 tok/s with 38.5 GB peak memory (github.com) 3 points by tdubey 1mo ago ↗ HN
[–] verdverm 1mo ago ↗ I've got the nvfp4 running on a spark, impressed enough so far I'm going to see if it can replace my qwen3.6 27B usageHave had issues with the dflash drafter and vllm, crashes, OOMs, broken thinking... so I'm back to the mid teens tok/s
1 comment
[ 5.3 ms ] story [ 16.4 ms ] threadHave had issues with the dflash drafter and vllm, crashes, OOMs, broken thinking... so I'm back to the mid teens tok/s