Joyfield

↗ HN profile [ 842 ms ] full profile
Karma
0
Created
()
Submissions
0
  1. As a sub project of my pet project DNSDigger.com i have developed a search engine that index robots.txt (http://en.wikipedia.org/wiki/Robots_exclusion_standard). I actually don't know what poeple could use this for but…

  2. I digged into my Index and found out.