Show HN: mlxsh A lightweight CLI to serve multiple local LLMs on Apple (github.com) 3 points by ansnadeem 2mo ago ↗ HN
[–] nittanymount 2mo ago ↗ machine memory is the bottleneck/limit for running local models, how is the memory handled? did not find notes on that on the repo readme page. could you explain, thanks.
1 comment
[ 3.4 ms ] story [ 12.3 ms ] thread