This is an interesting direction, especially the idea of treating attention as an indexed lookup. Would be great to see benchmarks or real-world use cases.
This is an interesting direction, especially the idea of treating attention as an indexed lookup. Would be great to see benchmarks or real-world use cases.