ADVERT

🤖 robots.txt Auditor

Paste your robots.txt file to inspect syntax errors, visualize user-agent coverage, and test whether URLs are blocked or allowed.

Audit your robots.txt coverage

Paste the contents of your robots.txt file to check for syntax warnings, review directives per user-agent, and simulate crawl access for specific URLs.

robots.txt source

Keep groups separated by blank lines. The auditor recognises Allow, Disallow, Crawl-delay, Sitemap, and Host directives.

Issues & guidance

No issues detected. Your robots.txt looks good!

Sitemaps

https://example.com/sitemap.xml

User-agent overview

Wildcard *Crawl-delay: 5s

Allowed paths

/public/ Allow Line 3

Disallowed paths

`/admin`	Disallow	Line 4
`/private`	Disallow	Line 5

googlebot

Allowed paths

/blog Allow Line 9

Disallowed paths

/experimental Disallow Line 10

URL simulator

Test URL

User-agent

✅ Allowed — No Allow/Disallow rules matched.

ADVERT

More like this

Format YAML, convert between YAML and JSON, and validate syntax instantly in your browser with offline support.

Decode JWT header and payload safely in your browser. Inspect claims and structure without sending tokens anywhere.

Create signed JSON Web Tokens with customizable headers and payloads. Choose HS256, HS384, or HS512 HMAC algorithms and copy the ready-to-use JWT.

Visually craft cron expressions with presets, interval selectors, and quick toggles. Copy the expression and preview the next scheduled runs instantly.

Parse cron expressions and preview next run times. Useful for devs managing scheduled tasks and crontab jobs.

Compute HMAC signatures with SHA-256, SHA-1, or MD5 using a secret key. Secure online hashing tool.

Test and debug JavaScript regular expressions. Highlight matches and quickly verify regex patterns.

Compose regular expressions with guided toggles for character sets, anchors, quantifiers, and flags. Test against sample input instantly.

ADVERT