# This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/ # ======================================================= # GROUP 1: General Search & Fallback # ======================================================= User-agent: * Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-includes/ Allow: /wp-includes/js/ Allow: /wp-includes/images/ Disallow: /trackback/ Disallow: /wp-login.php Disallow: /wp-register.php # ======================================================= # GROUP 2: AEO & AI Search Agents (CRITICAL FOR RANKING) # ======================================================= # These bots MUST access your content to cite you in # ChatGPT, Perplexity, Claude, and Gemini. # OpenAI (ChatGPT & SearchGPT) # OAI-SearchBot: Live search retrieval (Crucial for answers) # GPTBot: Model training (Helps AI "know" your brand) User-agent: OAI-SearchBot User-agent: GPTBot User-agent: ChatGPT-User # Anthropic (Claude) # Claude-SearchBot: Live retrieval for Claude citations User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User # Perplexity AI (Perplexity Answer Engine) User-agent: PerplexityBot User-agent: Perplexity-User # Google AI (Gemini/Bard Training Data) # Note: Googlebot (above in *) handles standard Search/SGE User-agent: Google-Extended # Apple Intelligence User-agent: Applebot-Extended # Common Crawl (Training data for many open-source models) User-agent: CCBot # Meta / Facebook AI User-agent: Meta-ExternalAgent User-agent: FacebookBot # Amazon (Alexa/Q) User-agent: Amazonbot # ByteDance (TikTok/Global Search) User-agent: Bytespider # DIRECTIVES FOR AI GROUP Allow: / Disallow: /wp-admin/ Disallow: /trackback/ Disallow: /wp-login.php Disallow: /wp-register.php # ======================================================= # SITEMAPS # ======================================================= Sitemap: https://cacpa.in/sitemap_index.xml