Internet Archive announces will ignore robots.txt (bit-tech.net)

2 points by feliceme 9y ago ↗ HN

1 comment

[ 3.7 ms ] story [ 15.8 ms ] thread

detaro 9y ago ↗

https://news.ycombinator.com/item?id=14163216