DeepSeek v4.1 flash runs 23 seconds/token on a 2020 16gb M1 Mac Mini (twitter.com) 1 points by ajay-higgs 1d ago ↗ HN
[–] spottedmarley 1d ago ↗ Nice! Totally different subject but, have you tried Ling-mini on it? It's really good for how small it is and you can run it on damn near anything and be useably quick.
[–] a012 1d ago ↗ You almost got me, it’s 2.6 tokens/minute [–] 361994752 1d ago ↗ I fell into the trap (again)
[–] killingtime74 1d ago ↗ I did a task that cost about $1.5 on API. It was 4 million tokens. That will take about 2.9 years at this rate.Estimating an electricity cost in the three digits
[–] esperent 1d ago ↗ That's 23 seconds for 1 token. Unusable, in other words. The title seems to be intentional written to obfuscate that.
9 comments
[ 0.18 ms ] story [ 8.3 ms ] threadEstimating an electricity cost in the three digits