HN Explorer

Buddo

↗ HN profile [ 16.2 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Show HN: I stopped using an LLM gateway and put rate-limits/fallback in-process (github.com)

    Sup HN. I built VernLLM cuz every LLM gateaway I looked at, meant adding a network hop just to get rate limiting, multi provider fallback, circuit breaking and other features. Needing to take a whole seperate service…

    1 points 4