Results 1 to 3 of 3

Thread: SE Spiders Is There A Way To...

  1. #1
    You do realize by 'gay' I mean a man who has sex with other men?
    Join Date
    Oct 2003
    Location
    New Orleans, Louisiana.
    Posts
    21,635

    SE Spiders Is There A Way To...

    Stop the spiders from crawling partial areas of HTML code?

    For instance if i have something towards the top of a page that i do not want to be crawled (because it might affect rankings) does anyone know of a way to have that omitted from the crawl but to also allow the rest of the HTML appearing on the page to continue to be crawled?

    Regards,

    Lee


  2. #2
    BDBionic
    Guest
    It'd be difficult, I'd imagine. These days Google, for one, pretty much spiders what it wants to spider on its own terms.


  3. #3
    You do realize by 'gay' I mean a man who has sex with other men?
    Join Date
    Oct 2003
    Location
    New Orleans, Louisiana.
    Posts
    21,635
    Yeah i hear ya on the Google issue.

    It would potentialy be possible using .php and includes where a useragent hitting a page gets given specific controls over what i can and cant see although im probably the least technical person i know

    Regards,

    Lee


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •