Over 1k tok/s on an RTX 5090 with Qwen3 0.6B (blog.alpindale.net)

1 comment

[ 3.4 ms ] story [ 12.3 ms ] thread

GitHub seems to be down right now, but the kernel is here: https://github.com/AlpinDale/qwen_megakernel (1,008 tok/s now, a bit improved after I made the blogpost)