Llama-3-70B instruct benchmarks

1 points by rkwasny ↗ HN
I find it very suprising, in my testing @FireworksAI_HQ is almost as fast as @GroqInc!

Time taken for get_groq_response_requests: 1.28 seconds

Time taken for get_together_ai_response_requests: 2.60 seconds

Time taken for get_fireworks_ai_response_requests: 1.42 seconds

Groq is still faster 1.28s vs 1.42s for fireworks, but I doubt they build their own chip

0 comments

[ 5.0 ms ] story [ 7.9 ms ] thread

No comments yet.