Inspects HTTP headers for indexing directives like noindex and nofollow.
The X-Robots-Tag is an HTTP response header that controls how search engines crawl and index your page or specific assets (like PDFs or images).
It overrides HTML meta tags. A 'noindex' directive here will block indexing even if the HTML says 'index, follow'. It's often used for non-HTML files where meta tags can't be used.
Accidentally serving an X-Robots-Tag with 'noindex' will completely remove the resource from search results.
Run a free audit to see how your site performs on X-Robots-Tag Header Check and 159 other checks.
Start Free Audit