1 comment

[ 2.7 ms ] story [ 12.7 ms ] thread
This is an interesting direction, especially the idea of treating attention as an indexed lookup. Would be great to see benchmarks or real-world use cases.