PDA

View Full Version : Preventing pages being added to Search Engines?!?



Anayet
September 27th, 2002, 22:34
How do i prevent certain pages of my website from being added to search engines?

When i search on search engines for my site, i find all of the links, i think its because those spiders/bots or whatever trawl all website pages and submit the info to the search engine right?

Anyway, i would much rather the search engine spiders just took the info of the main page, as opposed to give direct links to other pages within my sites - which at the moment, can make new visitors confused.

How do i prevent spiders from submiting entire site structures/links?


Thanks in advance:biggrin2:

ShockHost
September 29th, 2002, 03:33
If I can remember, there are meta tags that state to not to index page into search engine.

WebWizard
September 29th, 2002, 11:12
You can prevent Search Engines from indexing certain pages, by including the "robots" META tag in the HEAD section of each page, as follows:

<META NAME="robots" CONTENT="[see below]">

Where CONTENT can take the following forms:
"index,follow" - Index page, and all linked pages
"index,nofollow" - Index page, but no of it's links
"noindex,follow" - Don't index page, but index linked pages
"noindex,nofollow" - Don't index page, or any links!

Hope This Helps!

Kind Regards,
Mark Harrington,
The WebWizard - A 'Fully-Featured' HTML Editor for your WebBrowser!
Check us out at: http://www.the-webwizard.co.uk/

Anayet
September 29th, 2002, 15:27
Thanks for the help, appreciate it ;)