Wednesday 19 April 2017

Which search engine supports which robots meta tag values?

This table shows which search engines support which values:
Robots valueGoogleYahoo!MSN / LiveAsk
indexYesYesYesYes
noindexYesYesYesYes
noneYesDoubtDoubtYes
followYesDoubtDoubtYes
nofollowYesYesYesYes
noarchiveYesYesYesYes
nosnippetYesNoNoNo
noodpYesYesYesNo
noydirNo useYesNo useNo use

The different robots meta tag values

An explanation of all the different values you can use in the robots meta tags:
index
Allow search engines robots to index the page, you don’t have to add this to your pages, as it’s the default.
noindex
Disallow search engines from showing this page in their results.
noimageindex
Disallow search engines from spidering images on that page. Of course, if images are linked to directly from elsewhere, Google can still index them, so using an X-Robots-Tag HTTP header is a better idea.
none

This is a shortcut for noindex,nofollow, or basically saying to search engines: don’t do anything with this page at all.
follow
Tells the search engines robots to follow the links on the page, whether it can index it or not.
nofollow
Tells the search engines robots to not follow any links on the page at all.
noarchive
Prevents the search engines from showing a cached copy of this page.
nocache
Same as noarchive, but only used by MSN/Live.
nosnippet
Prevents the search engines from showing a snippet of this page in the search results and prevents them from caching the page.
noodp
Used to block search engines from using the description for this page in DMOZ (aka ODP) as the snippet for your page in the search results. However, DMOZ doesn’t exist anymore.
noydir
Blocks Yahoo! from using the description for this page in the Yahoo! directory as the snippet for your page in the search results. No other search engines use the Yahoo! directory for this purpose, so they don’t support the tag. Since Yahoo! closed its directory this tag is deprecated, but you might come across it once in awhile.

The resources from the search engines

The search engines themselves have pages about this subject as well:
You can block all robots at once by the markup above, or just block one robot by specifying it specifically:
Google
GOOGLEBOT
Yahoo!
SLURP
MSN / Live
MSNBOT
Ask
TEOMA


4 comments:

  1. NextGen APKS monitors all the latest consumer technology discoveries and shows you what is fresh, what matters and how technologies can enhance your life. We supply you with the advice, tools, and suggestions which can allow you to decide what to purchase and how to get the maximum from this technician in your life. With rigorous evaluation processes and systematic studies, NextGen APKS has gained the reputation of being the most honest title for reviews and previews through recent years. With the web edition, we wish to preserve the same standard across the board.

    website

    ReplyDelete
  2. You Search Web Hosting Site Visit This For Best Web Hosting Services

    ReplyDelete
  3. This comment has been removed by the author.

    ReplyDelete
  4. By outsourcing your B2B Lead Generation requirements, Vereigen Media can generate valuable business interest in your products and services.
    For More Details:- https://www.vereigenmedia.com/

    ReplyDelete