Show HN: a desktop app to discover, download, and run offline LLMs (lmstudio.ai) 10 points by ybu 3y ago ↗ HN
[–] dtagames 3y ago ↗ Looks very useful! Can't wait to try the Windows version. Thanks! [–] ybu 3y ago ↗ hopefully soon! [–] ybu 3y ago ↗ Follow up: Windows release is out.
[–] pearlsteinj 3y ago ↗ Wow, this makes running LLMs locally significantly more approachable. Very cool! [–] leeholim 3y ago ↗ Agreed!
[–] asselinpaul 3y ago ↗ This is great! CPU only for now or can it leverage GPU for sped up inference? [–] ybu 3y ago ↗ Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
[–] ybu 3y ago ↗ Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
8 comments
[ 3.5 ms ] story [ 33.0 ms ] thread