PowerRetention: a drop-in replacement for FlashAttention in LLMs (github.com)

2 points by dvrp 9mo ago ↗ HN

2 comments

[ 4.3 ms ] story [ 16.5 ms ] thread

dvrp 9mo ago ↗

Here’s an article I found from Manifest AI, the company behind Power Retention: https://manifestai.com/articles/what-is-power-retention/

jacobbuckman 9mo ago ↗

I am one of the authors, happy to answer any questions!