We want something fast so that it can help the human SRE. Jev won't be deciding what to escalate or de-escalate anyways. Preferably, both the human and LLM will be pinged at the same time and work in parallel.
Auditability does not come from an LLM or Jev but from the human operator themselves. Our Jev-driven diagnosis pipeline here is in the same role as all the AI SRE technologies on the market: they are tools to the human…
That's a good point. At the same time, a lot of an SRE's daily work is also processing recurring alerts that are of less significance. We believe that a Jev-driven pipeline can be a helpful to SREs in quickly analyzing…
Yeah, if the volume is small, then cost would not matter as much. But like I mentioned above, faster analysis and lower cost (than a full-fledged LLM!) is the goal, especially considering how much faster Jev is than an…
Yes! All faults in SREGym-lite (and the parent benchmark SREGym) have their ground truths reviewed by us to ensure that they are accurate to the incident. In addition, we also conducted an analysis to ensure the LLM…
This is amazing! We are also fascinated by how fast Jev is. It's very much a breath of fresh air in the age when LLMs tend to take a much longer time and reason about tasks.
Hello! One of the blog's co-authors here. Faster analysis and lower cost is the goal. We think that a Jev-driven pipeline can be a quick fast-path filter for a lot of alerts that are recurring or even false-positives.…
We want something fast so that it can help the human SRE. Jev won't be deciding what to escalate or de-escalate anyways. Preferably, both the human and LLM will be pinged at the same time and work in parallel.
Auditability does not come from an LLM or Jev but from the human operator themselves. Our Jev-driven diagnosis pipeline here is in the same role as all the AI SRE technologies on the market: they are tools to the human…
That's a good point. At the same time, a lot of an SRE's daily work is also processing recurring alerts that are of less significance. We believe that a Jev-driven pipeline can be a helpful to SREs in quickly analyzing…
Yeah, if the volume is small, then cost would not matter as much. But like I mentioned above, faster analysis and lower cost (than a full-fledged LLM!) is the goal, especially considering how much faster Jev is than an…
Yes! All faults in SREGym-lite (and the parent benchmark SREGym) have their ground truths reviewed by us to ensure that they are accurate to the incident. In addition, we also conducted an analysis to ensure the LLM…
This is amazing! We are also fascinated by how fast Jev is. It's very much a breath of fresh air in the age when LLMs tend to take a much longer time and reason about tasks.
Hello! One of the blog's co-authors here. Faster analysis and lower cost is the goal. We think that a Jev-driven pipeline can be a quick fast-path filter for a lot of alerts that are recurring or even false-positives.…