Ask HN: How do you monitor NLP models in production?

1 points by Nevin1901 ↗ HN
Those of you who use NLP models in production, how do you monitor them? I'm looking at deploying my own gpt-style nlp model soon, and I couldn't find many monitoring tools like one would find with http libraries, etc.

How do you guys monitor your nlp models in production, and what metrics/aspects of the model do you monitor?

1 comment

[ 4.8 ms ] story [ 9.0 ms ] thread