Key Points On how to use the Slurp tag

The Yahoo Directory is composed by humans and might contain information you may not wish displayed. The Yahoo’s directory contains many old snippets. The solution to this problem is very simple: add the following meta tag on every page:

meta name="robots" content="noydir"

This meta tag tells every search engine spider not to add the Yahoo Directory title or the meta description. If you want to make sure that Yahoo doesn’t use the Directory description, please add the following:

meta name="slurp" content="noydir"

A meta tag that corresponds with the SLURP tag is the NOODP meta tag. Displaying old information occurred because of the results from the Open Directory Project DMOZ. The website, with the old meta description, has a description and a link in the ODP listings (Open Directory Project). If you want to make sure that all the search engines won’t use this information you add :

meta name="robots" content="noodp"

If you want to block both the Open Directory and Yahoo Directory titles being used, you’ll need to add both of them:

meta name="robots" content="noydir"
meta name="robots" content="noodp"

Sometimes we notice that people address every spider seperately:

meta name="googlebot" content="noodp"
meta name="slurp" content="noodp"
meta name="msnbot" content="noodp"

Also adding the following will work :

meta name="robots" content="noydir,noodp"

If you want to block archiving, the meta tag to use will look as following :

meta name="robots" content="noydir,noodp,noarchive"