Ask HN: What is the best local model that runs on your Mac at decent speed?

1 points by carloslfu ↗ HN
What are your own experiences on this? What mac/specs do you have? what is your preferred AI to run on it? at how many tok/s does it run and how much memory does it take?

I'll start:

I have a MacBookP M5 Pro with 48GB, my favorite model is Qwen 3.8 Flash running at 14-15 tok/s and takes 21-24 GB of memory

0 comments

[ 0.20 ms ] story [ 10.2 ms ] thread

No comments yet.