1 comment

[ 4.4 ms ] story [ 13.5 ms ] thread
This is an interesting direction, especially the idea of treating attention as an indexed lookup. Would be great to see benchmarks or real-world use cases.