romain_batlle

↗ HN profile [ 35.0 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. Hey, I built an inference router that literally makes provider of LLM compete in real-time on speed, latency, price to serve each call. So it works on open and closed model, and for closed model price is fixed so…