9 comments

[ 0.18 ms ] story [ 8.3 ms ] thread
Nice! Totally different subject but, have you tried Ling-mini on it? It's really good for how small it is and you can run it on damn near anything and be useably quick.
You almost got me, it’s 2.6 tokens/minute
I did a task that cost about $1.5 on API. It was 4 million tokens. That will take about 2.9 years at this rate.

Estimating an electricity cost in the three digits

That is ≈0.043 token p/s. Impressive!
That's 23 seconds for 1 token. Unusable, in other words. The title seems to be intentional written to obfuscate that.