HN Explorer

defilan

↗ HN profile [ 28.2 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. 1 points 0
  2. 1 points 0
  3. Show HN: LLMKube – Kubernetes for Local LLMs with GPU Acceleration (github.com)

    Hi HN! I built LLMKube, a Kubernetes operator for deploying GPU-accelerated LLMs in production. One command gets you from zero to inference with full observability. Why this exists: Regulated industries (healthcare,…

    5 points 0