The Sparsity Nexus: Bypassing O(N²) Attention with Judy Arrays (axwise.de) 3 points by lunarain 5mo ago ↗ HN
[–] elena__s 5mo ago ↗ This is an interesting direction, especially the idea of treating attention as an indexed lookup. Would be great to see benchmarks or real-world use cases.
1 comment
[ 2.7 ms ] story [ 12.7 ms ] thread