g023

↗ HN profile [ 59.9 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. A high-performance local LLM server providing drop-in API compatibility with Ollama and OpenAI, built on llama.cpp's llama-server. Features automatic VRAM management, Hugging Face integration, and modular architecture.…

  2. Implements TurboQuant (ICLR 2026, arXiv:2504.19874) KV cache compression directly inside a Transformers inference script. All algorithms are self-contained. Minimal dependencies. - uses…

  3. An offline first focused agentic CLI application powered by local Ollama models. Integrated advanced memory management. Minimal dependencies. MIT licensed. DEFAULT USES A 4b Qwen 3.5 MODEL.…

  4. g023's OllamaMan - Ollama Manager OS style GUI management of ollama Server - Open Source LLM Management using PHP/JS/Sqlite and a web browser. Integrated apps for chat, terminal viewer, model management (can pull or…