1 comment

[ 4.0 ms ] story [ 18.1 ms ] thread
Fireworks makes that available with ~200 t/s (claims 300t/s). Ranks higher than llama3 on lmsys (right after GPT-4-0125-preview)