Probably the best reference is the SRE book, specifically the chapters on loadbalancing and distributed consensus protocols. Other than that, the general approach is to minimize global control planes and dependencies in…
Checking specifically for GCS at https://status.cloud.google.com/summary ... There are two outages there, one that only affected a few projects and one that affected only service in the central US (we have regions over…
Ok, I dug into this a bit. You got stuck in a trap in our current setup. We've improved the docs slightly to make this less common, we're going to fix up the error messages to be more clear, and we have a longer-term…
If it helps, I'll dig into this when I get into work. This is the first I've heard of this case. -Andrew, GCS
I think you're joking, but just for those that don't think that, we don't actually do that.
The issue that you're complaining about was due to the incident linked at [1]. I can't go into the technical details as to why this happened, but I can roughly explain that it was due to the CAP theorem, essentially…
I'm not sure why you're getting those quota errors, but I can assure you that we're not trying to pressure people to stop using SMTP and IMAP. If you post on the forums, some user support folks should be able to help…
It all depends. I don't know how Boomerang is implemented, but it's possible that with an account your size it's hitting some degenerate condition. One of our support folks should be emailing you and they'll help debug…
I'm sorry that trick isn't working for you. As you mention LKML causes slowdown, it's possible that you're getting an inordinate amount of mail. It's also possible you've got an agressive IMAP client that isn't using…
There are people working on those sorts of improvements, but it's not that straightforward so it takes time to get it right. The reason that it's not that straightforward is that lots of operations change state in your…
I have about 2.5 million emails in my work account and it still works really well, as a counter example. (I work at Google, on Gmail backend). If you've debugged it yourself and can't get to a good resolution (which it…
I was coming to this page just to post a comment like yours above. Thanks for doing that. I work on the Gmail backend team and we regularly see blogs go by such as this one. The vast majority of the times that prominent…
Probably the best reference is the SRE book, specifically the chapters on loadbalancing and distributed consensus protocols. Other than that, the general approach is to minimize global control planes and dependencies in…
Checking specifically for GCS at https://status.cloud.google.com/summary ... There are two outages there, one that only affected a few projects and one that affected only service in the central US (we have regions over…
Ok, I dug into this a bit. You got stuck in a trap in our current setup. We've improved the docs slightly to make this less common, we're going to fix up the error messages to be more clear, and we have a longer-term…
If it helps, I'll dig into this when I get into work. This is the first I've heard of this case. -Andrew, GCS
I think you're joking, but just for those that don't think that, we don't actually do that.
The issue that you're complaining about was due to the incident linked at [1]. I can't go into the technical details as to why this happened, but I can roughly explain that it was due to the CAP theorem, essentially…
I'm not sure why you're getting those quota errors, but I can assure you that we're not trying to pressure people to stop using SMTP and IMAP. If you post on the forums, some user support folks should be able to help…
It all depends. I don't know how Boomerang is implemented, but it's possible that with an account your size it's hitting some degenerate condition. One of our support folks should be emailing you and they'll help debug…
I'm sorry that trick isn't working for you. As you mention LKML causes slowdown, it's possible that you're getting an inordinate amount of mail. It's also possible you've got an agressive IMAP client that isn't using…
There are people working on those sorts of improvements, but it's not that straightforward so it takes time to get it right. The reason that it's not that straightforward is that lots of operations change state in your…
I have about 2.5 million emails in my work account and it still works really well, as a counter example. (I work at Google, on Gmail backend). If you've debugged it yourself and can't get to a good resolution (which it…
I was coming to this page just to post a comment like yours above. Thanks for doing that. I work on the Gmail backend team and we regularly see blogs go by such as this one. The vast majority of the times that prominent…