1 comment

[ 2.7 ms ] story [ 9.2 ms ] thread
A simplified implementation of FlashAttention in PyTorch for educational purpose.