mlenz
- Karma
- 0
- Created
- ()
- Submissions
- 0
-
LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve more than one local LLM at once which is not natively supported by vLLM. The LLMhop binary inspects the model…
- Astropad Workbench: Remote desktop made for the AI era (astropad.com)
- Nix Package Tool Approved for Availability in Fedora 44 (phoronix.com)
- How to use Nix to install software on macOS (appleinsider.com)
-
I work a lot with gRPC services and recently investigated the use in some of my JS apps. I found that gRPC-Web cannot directly communicate with regular gRPC services, requiring to set up some proxy (most likely envoy…
-
makejinja can be used to automatically generate files from Jinja templates. This allows you to load variables from external files or create repeating patterns via loops. A very interesting use case for this tool is…