3 comments

[ 1.7 ms ] story [ 15.4 ms ] thread
Pretty cool, it's missing how these concepts map to ThunderKittens code (my favorite CUDA toolkit)
Really interesting project, appreciated.
One of the best AI GPU Attention Kernel how-to-implement articles I've read in a long time!

Tremendous work, tremendous effort was placed into writing this article -- and it shows!

Well done!