Ask HN: Is anybody using llama.cpp for production? 11 points by HardikVala 11mo ago ↗ HN Considering the server version of llama.cpp for a commercial use case over bulkier options like vllm. But wondering if it's been battle-tested in production environments.
3 comments
[ 1.6 ms ] story [ 18.1 ms ] thread