Ask HN: Is anyone using Groq in production?
We tested out Groq with Llama 30B and saw an increased in inference speed, but the API was unreliable, sometimes not returning anything, which for us is a non-starter.
I am curious if anyone is using Groq in a production environment and if so, what their use case is?
0 comments
[ 2.9 ms ] story [ 14.8 ms ] threadNo comments yet.