Attaching to the app is impractical to catch regressions in production. LLMs are probabilistic - this means you can have a regression without even changing the code / making a new deployment. A metric to alert on could…
You use a tee https://en.wikipedia.org/wiki/Tee_(command)
Attaching to the app is impractical to catch regressions in production. LLMs are probabilistic - this means you can have a regression without even changing the code / making a new deployment. A metric to alert on could…
You use a tee https://en.wikipedia.org/wiki/Tee_(command)