Reddit now blocks all search engines other than Google following 'misuse' (9to5google.com) 6 points by tevelee 1y ago ↗ HN
[–] nness 1y ago ↗ robots.txt has always been a gentleman's agreement and for such a large site to abuse it in that way is ridiculous, and possibly, anti-competitive.
1 comment
[ 3.0 ms ] story [ 15.3 ms ] thread