HN Explorer

ban-lan-gen

↗ HN profile [ 36.9 ms ] full profile
Karma
6
Created
April 15, 2021 (5y ago)
Submissions
0
  1. Ask HN: How to store KV cache efficiently on disk?

    If I have a lot of precomputed KV cache values (basically just tensors), how do I store them efficiently on disk? Ideally, I would want to lookup their values by prefix quickly as well.

    1 points 0
  2. Dataflow Execution in GPU (arxiv.org)
    3 points 0
  3. HBF for GPUs (tomshardware.com)
    1 points 1