PowerRetention: a drop-in replacement for FlashAttention in LLMs (github.com)

Here’s an article I found from Manifest AI, the company behind Power Retention: https://manifestai.com/articles/what-is-power-retention/

I am one of the authors, happy to answer any questions!