1 comment

[ 1.9 ms ] story [ 15.4 ms ] thread
A simplified implementation of FlashAttention in PyTorch for educational purpose.