Meta and indexing directive checker

Inspect pasted HTML and response headers for indexing directives and canonical conflicts.

Your input is processed in this browser. Text and files are not uploaded or saved by this tool. Use up to 200,000 characters per text area.

Your input

Paste source HTML. It is inspected locally and never rendered as a webpage.

Include X-Robots-Tag and Link headers if available. Do not include cookies or authorization headers.

Enter your details or load an example, then run the tool.

Your result

Enter your details or load an example, then run the tool.

What it checks

  • Robots meta tags named robots, googlebot (including variants such as googlebot-news) and bingbot, with their full content.
  • X-Robots-Tag lines in the response headers you paste, including crawler-scoped rules such as "googlebot: noindex".
  • Canonical declarations, both <link rel="canonical"> in the HTML and a canonical Link response header.
  • The page title and meta description, so you can confirm you pasted the page you meant.

How to read the results

Indexing declarations lists every rule found. A noindex or none in a rule that applies to a crawler keeps the page out of that crawler’s index, even when another rule says index.

Check the scope of each rule: robots applies to every crawler, while a googlebot or bingbot meta tag, or an X-Robots-Tag prefixed with a crawler name, applies only to that crawler.

Canonical declarations should normally be a single URL pointing at the page itself. Two or more, or one pointing at another URL, means search engines may index a different page.

"None found" describes your input only. A robots.txt block, a server error or a directive added by JavaScript can still stop the page being indexed.

Questions, answered

Why is a page with noindex still showing in Google?

Google has to recrawl the page to see the directive, and keeps its existing copy until then. If robots.txt blocks the page, Google cannot read the noindex at all, so the URL can stay indexed.

Does an index directive cancel a noindex?

No. When rules conflict, Google applies the more restrictive one, so an applicable noindex wins. The checker flags pages that declare both.

Should I use the robots meta tag or the X-Robots-Tag header?

Both are honoured for HTML pages. The header also works for files without HTML, such as PDFs and images. Use one place per page so the two cannot disagree.

Is a canonical tag a directive?

No. It is a strong hint. Search engines can choose a different canonical when redirects, internal links or sitemaps point elsewhere, so keep those signals consistent with the tag.

Is the HTML I paste uploaded?

No. The tool parses your input in this browser without running its scripts or loading its images, and nothing is sent or saved.

What this tool can tell you

Reports declarations in your input, not live index status. JavaScript changes, missing headers and crawler-specific interpretation may change the outcome.

Need evidence across your website? Site Health inspects captured page evidence before you choose a fix.

Explore Site Health