Robots.txt Generator - Free Online Tool

AdSense code paste here (Top)

Robots.txt Generator

For site SEO management & dev purposes only

User-agent * (All) Googlebot Bingbot Custom

Disallow Paths

Allow Paths

Sitemap URL

Crawl-delay (seconds)

Additional User-agents (one per line)

Host Directive

Comments

Custom Directives

Generate robots.txt to see preview

AdSense code paste here (Sidebar)

AdSense code paste here (Bottom)