Growth

robots.txt Generator

Build allow and disallow rules per crawler with a sitemap line, then copy or download. Runs entirely in your browser, nothing is stored.

User agent

Allow (one path per line)

Disallow (one path per line)

Sitemap URL

User-agent: *
Allow: /
Disallow: /admin
Disallow: /private

Need more than a free tool?

Qawex builds, secures and grows websites and systems. Talk to a person.

Related tools

Title, description, canonical, robots, Open Graph and Twitter tags with length guidance.

See how your link card looks on Google, Facebook, WhatsApp and X before you share it.

Count words, characters, sentences and paragraphs, with an estimated reading time.

Turn questions and answers into FAQPage JSON-LD ready to paste into your page.