robots.txt Generator

Generate a robots.txt file for your website. Control search engine crawling behavior.

User-Agent

Disallow paths (one per line)

Allow paths (one per line, optional)

Sitemap URL (optional)

Crawl-delay (optional, seconds)