As to the extremely lengthy content of the page itself, the absence of the server should have been noticed by even the most rudimentary librenms or opennms type monitoring and alerting system. Alert went to one person by email? Uhhhh....
This kind of implies to me that they might well be Romanian, and might not speak English as a first language.
A quick look at their website suggests they're heavily invested into AI tooling, and are in Satu Mare in the north-west of Romania, which isn't especially near the Danube.
The incident is somewhat embarrassing for what appears to be a hosting provider. And the article is clearly written with a LLM. From a PR perspective that’s a peculiar combination. A bit more empathy and a human touch would probably have been a good move. Accidents and outages do happen, but reading the LLM article makes me feel like no one cares about what happened.
In my mind, postmortems with a human touch to be subtle defensiveness, passive aggressive blame, and unempathetic factual digs at others. I read the lack of empathy in the article as simply following best practices.
Clearly LLM written, and describing a design intended for a minimum of 6 servers that was running on 4. They don't say either way, but it seems possible to me that they might happen to write 3 chunks to a single machine and lose data on a one-machine failure
"That gap — between a system knowing and a person knowing — is the actual incident. Everything else is detail."
this copy is terrible.
It's like they made no effort no even slightly rewrite the garbage their LLM spat out at them and just copied and pasted it verbatim. Hardly inspires trust in the rest of their services if this is the care given to incident documentation.
7 comments
[ 0.22 ms ] story [ 19.6 ms ] threadAs to the extremely lengthy content of the page itself, the absence of the server should have been noticed by even the most rudimentary librenms or opennms type monitoring and alerting system. Alert went to one person by email? Uhhhh....
This kind of implies to me that they might well be Romanian, and might not speak English as a first language.
A quick look at their website suggests they're heavily invested into AI tooling, and are in Satu Mare in the north-west of Romania, which isn't especially near the Danube.
this copy is terrible.
It's like they made no effort no even slightly rewrite the garbage their LLM spat out at them and just copied and pasted it verbatim. Hardly inspires trust in the rest of their services if this is the care given to incident documentation.