User-agent: * Disallow: /wa/ User-agent: meta-externalagent Disallow: /wa/ User-Agent: DataForSeoBot Disallow: / User-Agent: dotbot Disallow: / User-Agent: ImagesiftBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: AnthropicBot Disallow: / User-agent: barkrowler Disallow: / User-agent: Claude Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CriteoBot Disallow: / User-agent: FriendlyCrawler Disallow: / #User-agent: ChatGPT-User #Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: SemrushBot Disallow: / User-agent: GenomeCrawlerd Disallow: / User-agent: AudigentAdBot Disallow: / User-agent: AwarioBot User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Leikibot Disallow: / User-agent: bidswitchbot Disallow: / User-agent: coccocbot-image Disallow: / User-agent: CCBot Disallow: / User-agent: Qwantbot Disallow: / User-agent: ias-va User-agent: ias_crawler User-agent: ias_wombles Disallow: / User-agent: wpbot Disallow: / User-agent: proximic Disallow: / User-agent: serpstatbot Disallow: / User-agent: SeekportBot Disallow: / User-agent: IbouBot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: LinkupBot Disallow: / User-agent: ias-ie Disallow: / User-agent: ias-or Disallow: / User-agent: Applebot User-agent: OAI-SearchBot User-agent: GPTBot Crawl-delay: 7200 User-agent: PerplexityBot Crawl-delay: 21600 User-agent: meta-externalagent Disallow: / User-agent: CriteoBot Disallow: / #User-agent: meta-externalagent #Crawl-delay: 43200 User-agent: WhatsApp Crawl-delay: 21600 User-agent: Amazonbot Crawl-delay: 21600 User-agent: bingbot Crawl-delay: 7200 User-agent: WhatsApp User-agent: Amazonbot User-agent: OAI-SearchBot User-agent: PerplexityBot User-agent: meta-externalagent User-agent: bingbot User-agent: msnbot Disallow: /*/amp User-agent: * Disallow: /*/amp User-agent: Googlebot Allow: /*/amp User-agent: Googlebot-Image Allow: /*/amp