Hi,
over in a German forum (http://www.pornhulk.net/) we plan to share our robots.txt and .htaccess lists for blocking IPs and Crawlers/Spiders.
Would anybody of you mind to contribute?
DEVELISH
Hi,
over in a German forum (http://www.pornhulk.net/) we plan to share our robots.txt and .htaccess lists for blocking IPs and Crawlers/Spiders.
Would anybody of you mind to contribute?
DEVELISH
Bookmarks