SiteTidy
Home /Tools /Meta Robots Generator

Meta Robots Generator

Control how search engines interact with individual pages on your site.

Meta Robots Generator

Take control of how search engines crawl and index your pages. Generate precise <meta name="robots"> tags.

Core Directives

Search engines are allowed to show this page in search results.

Search engines will follow links on this page to discover new content.

Advanced Directives

Generated HTML Snippet

<head> section
"text-indigo-400 font-bold"><meta "text-emerald-300">name="robots" "text-emerald-300">content="index, follow""text-indigo-400 font-bold">>

Implementation Notice

Place this snippet securely inside the <head> section of your HTML document. The default behavior is index, follow, meaning if this tag is completely omitted, search engines will naturally index the page and crawl links.

Robots.txt vs Meta Robots

While a robots.txt file dictates rules for your entire website (or specific folders), the robots meta tag gives you fine-grained control over individual pages. It allows you to specify whether a page should be shown in search results, and whether the links on that page should be followed by crawlers.

Common Use Cases

  • Staging Environments: Set your entire staging site to noindex, nofollow to prevent it from leaking into public search results.
  • Thank You Pages: Use noindex on checkout or lead generation "Thank You" pages so they can't be found directly via Google.
  • Internal Search Results: Often, you don't want Google indexing your internal site search pages. A noindex, follow tag prevents them from appearing in Google while still allowing link discovery.

Related Guides

Deepen your understanding with our expert articles.