[–] Alifatisk 4mo ago ↗ > 12 million token context window> 52x faster than FlashAttention at 1MM tokens> Less than 5% the cost of OpusThis sounds too good to be true? Or am I missing something?
1 comment of 2
[ 5.2 ms ] story [ 21.9 ms ] thread> 52x faster than FlashAttention at 1MM tokens
> Less than 5% the cost of Opus
This sounds too good to be true? Or am I missing something?