Ask HN: Is anyone using Groq in production?

3 points by digitcatphd ↗ HN
We tested out Groq with Llama 30B and saw an increased in inference speed, but the API was unreliable, sometimes not returning anything, which for us is a non-starter.

I am curious if anyone is using Groq in a production environment and if so, what their use case is?

0 comments

[ 2.9 ms ] story [ 14.8 ms ] thread

No comments yet.