1 comment

[ 3.3 ms ] story [ 6.4 ms ] thread
We take the latest open source models, and through a series of post-training, quantization and kernel specialization techniques, we make them run fast on local hardware.

We built some models which go super fast on local hardware, and optimised for time per task jobs.