We just doubled our speculative code edit throughput and hit 10k tok/sec per request!
Morph now merges code at 10,500 tokens/sec — roughly 4× faster than the best speeds on Cerebras.
That kind of speed makes previously impractical workloads trivial: applying complex edits across a 40k-token document now takes under 4 seconds. This isn’t a vanity metric - we think it unlocks an entirely new domain of AI use cases where codebases, configs, or long documents can be semantically edited in real time.
Morph is a Fast Apply model dedicated to merging edits from frontier LLMs
We want to enable developers to build realtime interfaces with AI
SEC ? they will be against this. They have been against financial innovation and if they see this they will be against this too. SEC is special. sec is ok
2 comments
[ 2.7 ms ] story [ 13.1 ms ] threadMorph now merges code at 10,500 tokens/sec — roughly 4× faster than the best speeds on Cerebras.
That kind of speed makes previously impractical workloads trivial: applying complex edits across a 40k-token document now takes under 4 seconds. This isn’t a vanity metric - we think it unlocks an entirely new domain of AI use cases where codebases, configs, or long documents can be semantically edited in real time.
Morph is a Fast Apply model dedicated to merging edits from frontier LLMs We want to enable developers to build realtime interfaces with AI