Ask HN: Self-hosting LLMs, is it worth the setup? 1 points by sb13 1y ago ↗ HN With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?
[–] 8thcross 1y ago ↗ people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind. [–] sb13 1y ago ↗ I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?
[–] sb13 1y ago ↗ I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?
3 comments
[ 2.9 ms ] story [ 20.1 ms ] thread