Quick

Robots Meta Tag Builder

Tick the directives you need and get a correctly formatted <meta name="robots"> tag or X-Robots-Tag header value.

Indexing

Other directives

Advanced limits

(-1 = no limit; characters shown in the text snippet)
(-1 = no limit, in seconds; 0 = static image only)
Advertisement

About this tool

The robots meta tag tells search engines what they may do with a page: noindex keeps it out of results, nofollow tells them not to follow its links, and the snippet and preview limits control how much of it appears in results. Choose “Applies to” to target one search engine, which changes the tag's name to, for example, googlebot. Notes appear for common mistakes, such as directives that cancel each other out or a tag that only repeats the default.

Switch to an X-Robots-Tag HTTP header for files that can't contain a meta tag, such as PDFs and images, and set it in your server config. Remember that a noindex page must stay crawlable (not blocked in robots.txt) or search engines never see the instruction, and that robots.txt controls crawling, not indexing. For whole-site rules use the robots.txt Generator.