# Allow OpenAI's GPTBot User-agent: GPTBot Allow: / # Allow ChatGPT Plugins / User Agent User-agent: ChatGPT-User Allow: / # Allow Anthropic's ClaudeBot User-agent: ClaudeBot Allow: / # Allow CCBot (Common Crawl) User-agent: CCBot Allow: / # Allow Google AI crawler User-agent: Google-Extended Allow: / # Allow Perplexity AI User-agent: PerplexityBot Allow: / # Allow Amazon's AI bot User-agent: Amazonbot Allow: / # Allow Meta / Facebook AI User-agent: facebookexternalhit Allow: / # Allow Applebot User-agent: Applebot Allow: / # Allow ByteDance (TikTok / AI training) User-agent: Bytespider Allow: / User-agent: * Allow: / Disallow: /*feed/ Disallow: /thank-you*/ Disallow: /*thank-you/ Disallow: /addons/ Disallow: /custom-quote/ Disallow: /compare/ Disallow: /checkout/ Disallow: /add-payment/ Disallow: /payment-login/ Disallow: /checkout/ Disallow: /favorites/ Disallow: /payment-accepted/ Disallow: /insurance-login/ Disallow: /insurance-payment/ Sitemap:https://www.stayporter.com/sitemap_index.xml Sitemap:https://www.stayporter.com/property-sitemap.xml