Yahoo! initially introduced a CSS class that can be used to notify robots/spiders that a specific section or fragment of content should not be included for search purposes.
class=”robots-noindex”
REFERENCES:
Tag: robots
Masquerading browser User-Agent strings
As it’s Halloween, it’s only relevant that I share a method of covering your browsers identity.
Interested in knowing your current User-Agent, just visit one of the following:
Many robots and spiders that are used by search engines also identify themselves by their User-Agent, if you see this activity in your logs you can often learn more about it at:
REFERENCES:
Happy Halloween!
robots-nocontent
SEO is always a tricky matter as it’s always changing, way back in 2007 Yahoo! added a means to ‘hide’ specific content on your page from it’s spider with the user of a CSS class that can be used anywhere on your page. True…. this can be abused, but is generally good to keep common content such as navigation and/or ads out of the index. Unfortunately, only Yahoo! supports this.
class="robots-nocontent"