User-agent: GPTBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: ChatGPT-User Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: OAI-SearchBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: Amazonbot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: ClaudeBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: Applebot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: PerplexityBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: GoogleOther Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: Meta-ExternalAgent Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: PetalBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: Google-CloudVertexBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: Factset_spyderbot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: QualifiedBot Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: ICC Crawler Disallow: /search Disallow: /discovery Disallow: /media/*/share User-agent: Bytespider Disallow: /search Disallow: /discovery Disallow: /media/*/share # Allow all other bots full access # User-agent: * # Disallow: