Robots.txt Generator
Generate robots.txt with allow/disallow rules, user-agents, crawl-delay, and sitemap.
Rules
Disallow paths
/admin/
Allow paths
Output
Live Audit (Fetch & Compare)
Related Tools
Meta Tag Generator
Generate perfect SEO meta tags, Open Graph, and Twitter Cards with live previews. Free, instant, and privacy-focused. No uploads required.
Schema Markup Generator
Generate JSON‑LD for Article, FAQ, HowTo, Product, LocalBusiness, Breadcrumbs and more.
Sitemap Generator
Create valid XML sitemaps by crawling a site or pasting URLs, with changefreq, priority, and lastmod options.
Keyword Density Checker
Analyze keyword frequency and density from text; copy or download CSV/Excel.
Frequently Asked Questions
Can I generate separate rules per bot?
Yes, add multiple user-agent sections with their own allow/disallow.
Will it validate conflicts?
We warn if the same path is both allowed and disallowed.
Is sitemap required?
Optional, but recommended for discovery.