"Some customers have reported intermittent resolution issues with .io domains. We can confirm that Route 53 DNS services are operating normally at this time and these issues seem to be related to the .io top-level domain provider."
I run a DNS monitoring service and have had a number of customers contact me about this in the past couple hours. Most of them were using Route53, but this is an issue with the IO authoritative nameservers, rather than Route53 itself.
It appears that the issue at first impacted all servers in the anycast pool however eventually it only impacted servers ns-a2 and ns-a4. Those servers started returning NXDOMAINs. I am wondering if this was related to the root server key change yesterday. .IO seems to struggle with basic DNS engineering. We are seeing stabilization except for minor issues still on one of the gTLD servers.
The root server key won't actually change until next month.
The DNSKEY responses from the root server was increased yesterday.
Speculation, but it could be they're running ancient versions of BIND that fail with the larger response size.
As per ICANN[0], the timeline is:
October 27, 2016: KSK rollover process begins as the new KSK is generated.
July 11, 2017: Publication of new KSK in DNS.
September 19, 2017: Size increase for DNSKEY response from root name servers.
October 11, 2017: New KSK begins to sign the root zone key set (the actual rollover event).
January 11, 2018: Revocation of old KSK.
March 22, 2018: Last day the old KSK appears in the root zone.
August 2018: Old key is deleted from equipment in both ICANN Key Management Facilities.
Interestingly enough I found that only some of them were returning NXDOMAIN's, so resolution would sometimes work and sometimes it would fail completely.
Well, the .io domain name is intended for the British Indian Ocean territory.
I think the common practice of misusing TLDs (such as registering an .io domain if you are not from the British Indian Ocean territory, or having a Soviet Union domain... a country that no longer exist), is bad.
However, I acknowledge this is not the root problem. The root problem is the scarcity of domains under traditional TLDs, and that's in great part due to speculation (e.g: domain parking). It is hard to establish what constitutes
placeholder content, therefore rules preventing domain parking are hard if not unfeasible to forbid.
Thankfully built-in parking AdBlock on newer browsers is forcing domain speculators to start dropping their less valuable names, as parking pages are no longer producing any revenue. I see most tech companies coming back to .COM once their given domain is available / priced cheaply as speculators are forced to sell.
28 comments
[ 4.0 ms ] story [ 46.4 ms ] thread"Some customers have reported intermittent resolution issues with .io domains. We can confirm that Route 53 DNS services are operating normally at this time and these issues seem to be related to the .io top-level domain provider."
October 27, 2016: KSK rollover process begins as the new KSK is generated.
July 11, 2017: Publication of new KSK in DNS.
September 19, 2017: Size increase for DNSKEY response from root name servers.
October 11, 2017: New KSK begins to sign the root zone key set (the actual rollover event).
January 11, 2018: Revocation of old KSK.
March 22, 2018: Last day the old KSK appears in the root zone.
August 2018: Old key is deleted from equipment in both ICANN Key Management Facilities.
[0]: https://www.icann.org/resources/pages/ksk-rollover
PS - thank you for mentioning this, I wasn't aware it was going to happen until reading your comment.
Not sure why that was taken of the front page suddenly.
https://twitter.com/bertjwregeer/status/910515512903319552
Interestingly enough I found that only some of them were returning NXDOMAIN's, so resolution would sometimes work and sometimes it would fail completely.
https://icannwiki.org/.pizza
My problem is that we have scripts all over customer websites hardcoded with api.gator.io
We're going to have to have them update the scripts and that is going to be a major pain.
> 1-844-GATOR-IO
I think the common practice of misusing TLDs (such as registering an .io domain if you are not from the British Indian Ocean territory, or having a Soviet Union domain... a country that no longer exist), is bad.
However, I acknowledge this is not the root problem. The root problem is the scarcity of domains under traditional TLDs, and that's in great part due to speculation (e.g: domain parking). It is hard to establish what constitutes placeholder content, therefore rules preventing domain parking are hard if not unfeasible to forbid.