HN Explorer

arnav__1

↗ HN profile [ 15.0 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. We Beat MLPerf: Modern Storage for KV Offload and LLM Training (theopenlake.com)
    1 points 1
  2. Show HN: ExANS – Lossless KV cache compression at 622 GB/s on H100 (theopenlake.com)

    Hi HN, We are the developers of OpenLake, an open source storage engine for KV cache offloading to remote disk and memory. Once we offloaded to local disk, we realized the bottleneck is the PCIe or NIC bandwidth. We…

    15 points 0
  3. Show HN: Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload (github.com)

    Hey HN, we’re the developers of OpenLake, an open source storage engine for offloading LLM KV caches from GPU memory into a shared tier of RAM and NVMe. We built OpenLake because KV caches are outgrowing GPU memory. A…

    22 points 3