darkolorin
- Karma
- 0
- Created
- ()
- Submissions
- 0
- Show HN: We made LM studio alternative based on own engine (trymirai.com)
Hi guys. We made own Mac app for M series hardware. Based on own engine called uzu (available with MIT on GitHub). Completely written from scratch and inference too. Our goal is to show what you can do with local…
-
We wrote our inference engine on Rust, it is faster than llama cpp in all of the use cases. Your feedback is very welcomed. Written from scratch with idea that you can add support of any kernel and platform.
- MBA Harvard Feels Undervalued (old.reddit.com)
- Faster Inference Than MLX (trymirai.com)
- 90T/s on my iPhone llama3.2-1B-fp16 (reddit.com)
- ONNX to CoreML (github.com)
- DIY Prisma app with CoreML (blog.prismalabs.ai)
- Torch to CoreML (github.com)
- Learn your style for Prisma (styles.prisma-ai.com)
- AI goes massive with Prisma (prisma-ai.com)
- Quantum product (medium.com)