HN Explorer

Ask HN: What is your LLM monitoring stack?

5 points by aiunboxed ↗ HN
What do you use for tracing llm calls etc ?

1 comment

[ 2.8 ms ] story [ 13.4 ms ] thread
chitraa
Consider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.