mlenz

↗ HN profile [ 118 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve more than one local LLM at once which is not natively supported by vLLM. The LLMhop binary inspects the model…

  2. I work a lot with gRPC services and recently investigated the use in some of my JS apps. I found that gRPC-Web cannot directly communicate with regular gRPC services, requiring to set up some proxy (most likely envoy…

  3. makejinja can be used to automatically generate files from Jinja templates. This allows you to load variables from external files or create repeating patterns via loops. A very interesting use case for this tool is…