Results 1 to 3 of 3

Thread: Anyone Have A List Of SE Spider IP Addresses?

  1. #1
    You do realize by 'gay' I mean a man who has sex with other men?
    Join Date
    Oct 2003
    Location
    New Orleans, Louisiana.
    Posts
    21,635

    Anyone Have A List Of SE Spider IP Addresses?

    Ive been going through the server log files on GWW and am seeing the same ip addresses coming up time and time again hitting pages that, quite frankly, 'real' people shouldnt be hitting

    If anyone has a list of the search engine spiders ip addresses handy it would be a great help if you could share them so i can narrow down whats happening

    Regards,

    Lee


  2. #2
    Moderator Bec's Avatar
    Join Date
    Nov 2003
    Location
    Ohio
    Posts
    8,419


  3. #3
    BDBionic
    Guest
    I used to have a list of all the Google spider IPs, even categorized depending on what update they were likely spidering for and whether they were the deep, hardcore spiders or just the everyday ones.
    But awstats and various other stats programs have started incorporating SE IPs in to their reporting, telling you when and how often you're getting spidered and so that just made me get lazy on it and now that list is lost somewhere and probably out of date hehe.


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •