The attention lottery framing feels especially timely now that DeepSeek's V3.2 tech report is out in the open. Seeing the actual top-k sparse routing and the post-training RL numbers spelled out makes the trade-offs…
Ya. It seems like evolution itself has been running a sparsity experiment for millions of years. Sparse attention may be the universal price of survival: efficiency over imagination, precision over possibility. The line…
lol. I keep on hitting my usage limits but I haven't upgraded my Claude Code CLI... so I just continue https://www.youtube.com/watch?v=2jmWnPfgtik [End] --- for the visuals, reflect on the lyrics... think about AI…
The attention lottery framing feels especially timely now that DeepSeek's V3.2 tech report is out in the open. Seeing the actual top-k sparse routing and the post-training RL numbers spelled out makes the trade-offs…
Ya. It seems like evolution itself has been running a sparsity experiment for millions of years. Sparse attention may be the universal price of survival: efficiency over imagination, precision over possibility. The line…
lol. I keep on hitting my usage limits but I haven't upgraded my Claude Code CLI... so I just continue https://www.youtube.com/watch?v=2jmWnPfgtik [End] --- for the visuals, reflect on the lyrics... think about AI…