You’re robots.txt file and the robots meta tag is your instruction guide to search engine robots who visit your website. You may also hear this referred to as The Robots Exclusion Protocol or the Robots Exclusion Standard. With the use of this tag you can control whether search engine robots have access to your website and to specific pages; whether or not they are given permission to index these pages; and whether or not they should follow any links listed on those pages.
The generator below will help you generate the necessary robots meta tag to help control what search engine bots do with your website.
Older browsers & certain mobile platforms may not display the above generator correctly. If this is the case for you please use the following link to access the generator: Robots Meta Tag Generator