Robots Directives
What is Robot Directive?
A robot (meta tag) directives gives search engine crawlers instructions on how to crawl and index information they find on a specific webpage on your website.
Why You Need It
By default, a search engine crawler indexes all pages on your website, including the text, images and links. You can choose to instruct the crawlers not to index a page or follow any links on specific pages on your website.
What SEO Pyramid Offers
SEO pyramid gives you the option of having your website crawled or have special pages on your website to be omitted..
Leave a Reply