Checks for disallowed paths in the robots.txt file.
A `Disallow` directive in your `robots.txt` file tells search engine crawlers not to access a specific file, directory, or section of your website.
It's used to block access to non-public sections (like admin logins), or to prevent crawling of pages that provide no value in search (like internal search results).
Incorrectly using `Disallow` is extremely dangerous. A single wrong line, like `Disallow: /`, can block your entire website from being crawled and indexed by search engines.
User-agent: *
Disallow: /admin/
Disallow: /search-results.phpRun a free audit to see how your site performs on Disallow Directive Test and 159 other checks.
Start Free AuditChecks for the presence of a nofollow meta tag.
Reports how many internal links point to each page and identifies under-linked important pages.
Analyzes internal link anchor text for diversity, generic anchors, and over-optimization.
Identifies internal links marked with rel="nofollow" where that is likely unintended.