Throughput vs. Goodput: The Performance Metricin LLM Testing (qainsights.com)

1 points by qainsights 1mo ago ↗ HN

1 comment

[ 4.4 ms ] story [ 16.7 ms ] thread

Difference between throughput and goodput, why throughput alone can give you a dangerously false sense of confidence.