-
You do realize by 'gay' I mean a man who has sex with other men?
SE Spiders Is There A Way To...
Stop the spiders from crawling partial areas of HTML code?
For instance if i have something towards the top of a page that i do not want to be crawled (because it might affect rankings) does anyone know of a way to have that omitted from the crawl but to also allow the rest of the HTML appearing on the page to continue to be crawled?
Regards,
Lee
-
It'd be difficult, I'd imagine. These days Google, for one, pretty much spiders what it wants to spider on its own terms.
-
You do realize by 'gay' I mean a man who has sex with other men?
Yeah i hear ya on the Google issue.
It would potentialy be possible using .php and includes where a useragent hitting a page gets given specific controls over what i can and cant see although im probably the least technical person i know
Regards,
Lee
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
Bookmarks