Hopefully this also helps against the rampant CTR manipulation that’s made some search results purely a measure of spend.
I agree it’s probably not representative token speed. But I do believe the overall observation holds: The value of local inference is bound by the wall clock. I agree that there are many other reasons than cost alone.
With roughly 2.7 million seconds per month, times 14 tokens per second, you are getting 38.5 million tokens a month at most. That’s less than 164USD worth of GLM5.3 tokens on the inference market. So that 6000 USD rig…
My main issue with Codex and many other harnesses is the permission flow. For just about every other harness it’s either alert fatigue answering permission asks all the time, or spending too long time hoping that you…
It’s a marketplace with a markup on every token they sell. And I’d rather go to this shop, than sign up individually at the 70+ different providers they broker access to - even if it comes with a price.
Oral Defences have a long established tradition in Denmark, but recently there’s been real cut back on this as a money saving exercise. So both teachers and Students are familiar with this form of examination. So for a…
This also fails to take into account that ISBNs also contain the publisher ID in them. So identical copies of a book could have different ISBNs depending on which markets they are sold in.
LOCKSS is short for: Lots of copies keeps stuff safe. This is for digital material where perpetual usage rights have been granted, but the original source might not be available. It’s also used to make sure that journal…
Hopefully this also helps against the rampant CTR manipulation that’s made some search results purely a measure of spend.
I agree it’s probably not representative token speed. But I do believe the overall observation holds: The value of local inference is bound by the wall clock. I agree that there are many other reasons than cost alone.
With roughly 2.7 million seconds per month, times 14 tokens per second, you are getting 38.5 million tokens a month at most. That’s less than 164USD worth of GLM5.3 tokens on the inference market. So that 6000 USD rig…
My main issue with Codex and many other harnesses is the permission flow. For just about every other harness it’s either alert fatigue answering permission asks all the time, or spending too long time hoping that you…
It’s a marketplace with a markup on every token they sell. And I’d rather go to this shop, than sign up individually at the 70+ different providers they broker access to - even if it comes with a price.
Oral Defences have a long established tradition in Denmark, but recently there’s been real cut back on this as a money saving exercise. So both teachers and Students are familiar with this form of examination. So for a…
This also fails to take into account that ISBNs also contain the publisher ID in them. So identical copies of a book could have different ISBNs depending on which markets they are sold in.
LOCKSS is short for: Lots of copies keeps stuff safe. This is for digital material where perpetual usage rights have been granted, but the original source might not be available. It’s also used to make sure that journal…