How to use this robots.txt checker

  1. Enter the site root URL (https://example.com/).
  2. Review whether Googlebot or Bingbot are blocked from the whole site.
  3. Copy sitemap URLs for the sitemap checker.

Run the check

Public HTTP(S) URLs only, no query strings. Rate limits apply.

Monitor this automatically

Save your site in Traffivio and get scheduled audits, health checks and agent proposals.

Sign up free ↗

Questions

Does this validate every robots directive?

It parses common User-agent, Allow, Disallow and Sitemap lines. Complex patterns are not simulated.

Do I need an account?

No. These tools work without signing in. Rate limits apply per visitor.

Does Traffivio change my site?

No. Server tools only fetch public URLs. Counters run entirely in your browser.