vLLM-iOS: 88% Faster Multi-Agent Inference on iOS (jonready.com)

2 points by mips_avatar 2mo ago ↗ HN

3 comments

[ 0.25 ms ] story [ 14.1 ms ] thread

mips_avatar 2mo ago ↗

Direct link to the repo on github: https://github.com/jonready/vllm-ios

maestroquirk 2mo ago ↗

super cool project! bravo!

[dead] harisingh1612 2mo ago ↗

[flagged]