Robots nofollow [Mechanical engineering]

Robots nofollow

About the Robots tag

You can use a special HTML tag to tell robots not to index the content of a page, and/or not scan it for links to follow.

For example:

There are two important considerations when using the robots tag:

  • robots can ignore your tag. Especially malware robots that scan the web for security vulnerabilities, and email address harvesters used by spammers will pay no attention.
  • the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.

Don't confuse this NOFOLLOW with the rel="nofollow" link attribute.

The details

Like the /robots.txt, the robots META tag is a de-facto standard. It originated from a "birds of a feather" meeting at a 1996 distributed indexing workshop, and was described in meeting notes.

The rest of this page gives an overview of how to use the robots tags in your pages, with some simple recipes. To learn more see also the FAQ.

Where to put it

Like any tag it should be placed in the HEAD section of an HTML page, as in the example above. You should put it in every page on your site, because a robot can encounter a deep link to any page on your site.

What to put into it

The "NAME" attribute must be "ROBOTS".

You might also like
Robots nofollow links in website SEO
Robots nofollow links in website SEO
Robots NoFollow
Robots NoFollow


Is robots index/follow, in the absence of any noindex/nofollow restriction, useful? - Quora

It's no use in using index,follow since most search engines by default follows the index,follow,all philosophy.
Rather, there are other combinations:

  1. noindex/follow: For removing duplicate contents from index, but still flow the link juice through all the pages in the site, and
  2. index/nofollow: For pages with links to user based contents aka login pages. It also can be used for pages that have external links or pages with more than 100 links. And sometimes for PR Herding.

These 2 are also helpful.

HTML Meta Tags - Robots "index, nofollow"? | Yahoo Answers

The page rank is mostly beside the point - the content of your pages will be hidden from the search engine, the only content that will be indexed will be the navigation.
Basically - don't use frames for this. They are not at all suited to it.
Use includes (server side or preprocessed) to include the navigation on each page instead.
(Remove the space from the URL above, it is there to avoid Answers truncating it)

Related Posts