We're working on provable inference at Attestable (https://attestable.com/) - our solution is one of the comparisons provided. We've published initial performance metrics in August of 87 t/s on Muse Glimmer 30B (a dense…
We're working on provable inference at Attestable (https://attestable.com/) - our solution is one of the comparisons provided. We've published initial performance metrics in August of 87 t/s on Muse Glimmer 30B (a dense…