HN Explorer

vdev-ctrl

↗ HN profile [ 22.9 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. ALHR-A tree based sparse attention system that retains long context accuracy

    ALHR - Adaptive Learnable Hierarchical Routing, uses static binary trees and learnable functions to minimize the amount of keys to be read. It does use a dense teacher while phase 1 of training however. MQAR TEST AT…

    1 points 0