Run a large language model on your iPhone. No internet is needed (github.com) 2 points by tarassenkov 1d ago ↗ HN
[–] tarassenkov 1d ago ↗ Speed depends on the phone. On an iPhone 13 Pro: GigaChat ~7 words/second, Ling ~12, Gemma ~3. Newer phones with 8 GB of RAM are faster.
1 comment
[ 0.17 ms ] story [ 24.9 ms ] thread