HN Explorer

Should I reconsider my decision of self-hosting LLM Gateway?

1 points by leanroute_ai ↗ HN
The CVE-2026-35029 privilege escalation in LiteLLM is a reminder that middleware is not something you can install once and forget. What is your view on using self-hosted LLM gateway? I wrote this post - https://leanroute.dev/blog/self-hosting-an-llm-gateway Would like to hear your views.

6 comments

[ 0.27 ms ] story [ 9.7 ms ] thread
FatalLogic
Isn't this a general class of problem that has a similar risk profile for any type of gateway that accepts inputs that are not very tightly bounded?

Not only LLM services.

verdverm
I'm running a gateway for my local LLMs, are you opening it to the internet? Who's going to craft a malicious payload?