HN Explorer

pythongiant

↗ HN profile [ 55.0 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. 1 points 0
  2. 1 points 0
  3. Show HN: TurboQuant for mlx-lm (Apple Silicon) (github.com)

    Hi HN, I built mlx-turboquant, an implementation of Google's TurboQuant KV-cache compression algorithm for Apple's MLX framework. The repository includes quality benchmarks, memory benchmarks, and a modular…

    1 points 1
  4. Show HN: KVBoost – chunk-level KV cache reuse for HuggingFace, 5–48x faster TTFT (pythongiant.github.io)
    20 points 8
  5. CUDA Programming: From Zero to GPU Kernels – A Beginner's Guide (pythongiant.github.io)
    1 points 1
  6. Show HN: I built GPT from scratch to understand how it works (pythongiant.github.io)

    If you’ve ever been curious about how GPT actually works under the hood, I built a small project you might find interesting. I implemented a GPT-style transformer from scratch in a single notebook—covering tokenization,…

    7 points 0