A clearer view of your website.
Test crawler rules, inspect page declarations and prepare better markup. Six focused tools, with your input processed right in your browser.
Start with crawl access
What do your crawler rules actually allow?
Test a page against your robots.txt and see the exact matching rule for each crawler. Keep search discovery and training permissions distinct.
Choose the task in front of you.
Paste text, enter details or choose a local file. No API credits, account or website connection needed.
AI crawler rules tester
Find which crawlers your robots.txt allows, with the exact rule behind each result.
Paste robots.txtRobots.txt generator
Choose crawler permissions, add your sitemap and download a tested starting point.
Choose permissionsMeta and indexing directive checker
Inspect pasted HTML and response headers for indexing directives and canonical conflicts.
Paste HTML and headersStructured data builder
Create Article, Organization or Breadcrumb JSON-LD from facts you provide.
Enter page detailsSitemap comparison
Compare two XML sitemap files and export the URLs added, removed and kept.
Upload or paste XMLSocial preview tool
Preview your title, description and image, then copy the corresponding social tags.
Enter share detailsSmall checks. Clear limits.
These tools inspect what you supply. They do not fetch websites or prove indexing, rankings or AI citations. Your pasted text and files are not uploaded or saved by these tools.