[–] platers 1y ago ↗ Flash attention natively supports packing multiple variable length sequences into a single call, what is the advantage of jagged flash attention? [–] [deleted] 1y ago ↗ (comment deleted) [–] bbstats 1y ago ↗ If only there was a link to a page somewhere that could answer this question for you.
[–] bbstats 1y ago ↗ If only there was a link to a page somewhere that could answer this question for you.
[–] CapsAdmin 1y ago ↗ See alsohttps://github.com/thu-ml/SageAttention and https://github.com/thu-ml/SpargeAttn
4 comments
[ 4.6 ms ] story [ 88.6 ms ] threadhttps://github.com/thu-ml/SageAttention and https://github.com/thu-ml/SpargeAttn