I'm not knowledgeable enough to answer that question. However, this is the only Twitter comment that mentions this on their page, and I don't have access to a Verizon account to verify their outage status memo. We had a flurry of employees saying their connections were going haywire to the business and this is the only thing I've been able to gather outside of downdetector.
This is speculation, of course, but: there are several large Internet Exchanges in NYC, and US/EU peering points. It's probable that a fiber cut could have cut several other links, and the failover links are now completely overwhelmed.
Issues with FiOS in the Boston area. Traceroute seems to point to an issue originating in NY but that's just speculation. Apparently a lot of other services are down. Might be a Tier 1 or 2 ISP.
My corporate laptop is affected. My roommate’s corporate laptop is totally unaffected. We’re on the same router/gateway.
Any theories out there to explain this phenomenon? Fascinating.
(My theory is a network partition, where my roommate’s IP addresses happen to be in regions that are on “our side” of the partition, whereas my IP Addresses are on the “other”, unreachable side).
Are you using different DNS servers? My work laptop was using 8.8.8.8 and is getting name resolution errors, but my personal computer is using 1.1.1.1 and working fine.
Apparently, Verizon's outage page doesn't actually say if there's an outage. You have to log in to see if there's an outage. Too bad logins are failing after ~10 minutes for me.
Honestly, at this point I've found HN to be the best "Status Page" for this sort of thing. I came here first when I found issues and fiddling around with my custom DNS lookup hierarchy didn't help.
I'm glad I'm not the only one noticing this. I could usually rely on HN to not be so heavily "filtered" for a lack of a better term but I have noticed the slide into a more controlled/gamed PR outlet.
It set off the flamewar detector. We monitor that list and eventually cancel the penalty for threads that aren't actual flamewars, but it takes a while. If anyone wants to make it faster, emailing hn@ycombinator.com is usually a forcing function.
Edit: Also, posts without URLs get a downweight by default. I've turned that off too, and merged the other threads into this one, since it was the first one.
> How does one programmatically detect a flamewar? :)
An NLP/Machine learning model would be a great way! Probably also taking in other features as input such as the number of comments per second, and how deeply nested those comments are.
That's answered in my sibling (well, cousin) comment here: https://news.ycombinator.com/item?id=25921757. It can't test for flamewars directly so it ends up guessing wrong sometimes.
downdetector.com did well today. Front page showed a generalized web issue, and any one of the individual services' status pages showed it was geographically localized to the midatlantic and northeast US.
264 comments
[ 5.9 ms ] story [ 254 ms ] threadDoesn't look like it's isolated to any one provider, or any one site. https://downdetector.com is showing many issues across many platforms.
There is a fiber cut in Brooklyn. We have no ETR, as of yet. You can use the MY Fios app for updates. *EAG
https://www.wsj.com/articles/verizon-internet-outage-disrupt...
> The company hadn’t pinned down the source of the failure as of Tuesday afternoon.
Any theories out there to explain this phenomenon? Fascinating.
(My theory is a network partition, where my roommate’s IP addresses happen to be in regions that are on “our side” of the partition, whereas my IP Addresses are on the “other”, unreachable side).
In any case, it looks like it’s ended for us. The window for gathering evidence slides closed...
It’ll be interesting to read the post mortem on this one.
https://www.verizon.com/support/residential/service-outage
Although my packet loss to my IPv6 tunnel provider just went to zero, so that's a good sign here (Manhattan).
FiOS customer in DC Metro.
Edit: Also, posts without URLs get a downweight by default. I've turned that off too, and merged the other threads into this one, since it was the first one.
An NLP/Machine learning model would be a great way! Probably also taking in other features as input such as the number of comments per second, and how deeply nested those comments are.
Let's build one!
Why? There do not appear to have been any posts remotely resembling a flamewar in the comments.
edit: as of 13:20 (GMT-5) it appears to be resolved.