Ask HN: Why use Ollama for Containerized on-prem PROD use?
I see ollama being used for production applications via a containerized on-prem deployment. Why would ollama be a good solution instead of straight llama.cpp or something more industrial grade like vLLM? I see Ollama's use case as individuals running stuff on laptop/home setups.
0 comments
[ 3.1 ms ] story [ 7.9 ms ] threadNo comments yet.