[flagged]
Replying since this one didn’t get an answer. I’ve been building a gateway too and usage reporting is the annoying part. Groq only gives you usage on streamed responses if you ask for it with stream_options, otherwise…
[flagged]
[flagged]
Replying since this one didn’t get an answer. I’ve been building a gateway too and usage reporting is the annoying part. Groq only gives you usage on streamed responses if you ask for it with stream_options, otherwise…