All tools

Make crawler access
clear.

Check robots.txt rules for your exact URL, including search and AI crawlers. See the matching rule, HTTP indexing headers and sitemap responses.

Fetches the page, robots.txt and at most three same-origin sitemaps. Crawl permission does not guarantee indexing or AI citations. Results describe the response to our checker, not a live visit by each named bot.

Access evidence