The Sparsity Nexus: Bypassing O(N²) Attention with Judy Arrays (axwise.de) 3 points by lunarain 3mo ago ↗ HN
[–] elena__s 3mo ago ↗ This is an interesting direction, especially the idea of treating attention as an indexed lookup. Would be great to see benchmarks or real-world use cases.
1 comment
[ 4.4 ms ] story [ 13.5 ms ] thread