felineflock

↗ HN profile [ 76.5 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. AI Home Lab for Beginners: The Deep Dive (augmentedmind.substack.com)
  2. I have been benchmarking local LLMs on a Mac M4 Pro 24 GB RAM using LM Studio. I've tested mostly with 4-bit quantization, both MLX and GGUF, from 4b to 35b models, with speeds of 3 to 40 tokens/second. Results briefly:…