Robots.txt Generator for AI Bots
Generate a robots.txt file that protects WordPress sensitive areas while allowing AI crawlers
Select AI Bots to Allow:
GPTBot (ChatGPT)
Google-Extended (Bard/Gemini)
ClaudeBot (Claude)
CCBot (Common Crawl)
PerplexityBot
Bytespider (TikTok)
Omgilibot
FacebookBot (Meta AI)
WordPress Protection:
Block sensitive WordPress directories
Generate robots.txt
Your robots.txt:
Copy to Clipboard
Download robots.txt