vLLM-iOS: 88% Faster Multi-Agent Inference on iOS (jonready.com)

2 points by mips_avatar 18d ago ↗ HN

3 comments

[ 0.28 ms ] story [ 3.2 ms ] thread

mips_avatar 18d ago ↗

Direct link to the repo on github: https://github.com/jonready/vllm-ios

maestroquirk 18d ago ↗

super cool project! bravo!

[dead] harisingh1612 18d ago ↗

[flagged]