Ask HN: Why use Ollama for Containerized on-prem PROD use?

2 points by dcreater ↗ HN
I see ollama being used for production applications via a containerized on-prem deployment. Why would ollama be a good solution instead of straight llama.cpp or something more industrial grade like vLLM? I see Ollama's use case as individuals running stuff on laptop/home setups.

0 comments

[ 3.1 ms ] story [ 7.9 ms ] thread

No comments yet.