HN Explorer

Linode Data Corruption and Issues

1 points by kundi ↗ HN
Here's the email I received from Linode today:

Hello,

I'm very sorry to inform you that there was an issue on the host that your Linode resides on which resulted in the loss of your Linode's data. Our administrators have attempted to recover your Linode's data, but have not been successful.

Due to the severity of the issue, the Linode is unrecoverable and we are unable to migrate it to a new host. Please accept our deepest apologies. We do have measures in place to prevent this kind of data loss but unfortunately, those features could not prevent today's failure.

While we understand that no amount of money can make up for lost data, we have gone ahead and credited your account for 3 months worth of service for the Linode that was impacted. This credit will be automatically applied towards future invoices.

We recommend redeploying your Linode from any external backups if they are available. While unlikely, you may be able to recover some data by rebooting your server into rescue mode and performing a file system check. I've provided the link to our documentation for assistance:

Booting Into Rescue Mode

Performing A File System Check

This is certainly not the experience that we want you to have while on our platform, nor is it the level of reliability we want you to expect from us. We can assure you that we will be performing a further investigation of this to better prevent further similar incidents. Please let us know if you have any questions for us.

Kind Regards, Mark Linode Support Team

---

It happened that our server hosting exitmist.com service lost all our data and leads that we've collected.

How would you react to the situation?

What is your experience with Linode?

4 comments

[ 5.4 ms ] story [ 16.3 ms ] thread
robertcope
These things happen to computers. You should have been taking backups. Any data loss is on you. Seems like Linode responded reasonably, in my opinion.

I would react by rebuilding my server(s) and restoring the backed up data.

rgacote
Long-time Linode user here. Stuff happens. Agree Linode responded appropriately. I use their automated daily backup service but also maintain off-server redundant copies of critical data.

Learn from the experience, review your backup and management policies, restore from last available backups.

kundi
The problem is that its not the first time we're having issues with Linode. And yes, thinks happen, but the question is how often and on what extent. In my opinion, Linode is not a reliable company with exceptional service, and we will be migrating all our servers away from them.
robertcope
I've run stuff there for years and never had an issue. I have been transitioning stuff to Digital Ocean, but really only because I like that they have an actual firewall that I can control. Also been moving more stuff to AWS. But, back to Linode, never had any major issues.