Gemma locally on iOS, Android, web browsers, and GPUs with a single framework (old.reddit.com)

5 points by CharlieRuan 2y ago ↗ HN

1 comment

[ 3.4 ms ] story [ 9.7 ms ] thread

crowwork 2y ago ↗

2b model running at 20tok/sec on iphone, nice potential for future applications