User-agent: * Disallow: /miembros/perfil/* User-agent: * Disallow: /*/miembros/perfil/* User-agent: * Disallow: /members/profile/* User-agent: * Disallow: /*/members/profile/* User-agent: * Disallow: /membros/perfil/* User-agent: * Disallow: /*/membros/perfil/* User-agent: * Disallow: /auth/register/facebook User-agent: * Disallow: /*?*fromPath= User-agent: * Disallow: /*?*query= User-agent: * Disallow: /*?*anio= User-agent: * Disallow: /*?*setSessionCountry= User-agent: 360Spider User-agent: AhrefsBot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: Baiduspider User-agent: Barkrowler User-agent: BLEXBot User-agent: Caliperbot User-agent: DataForSeoBot User-agent: DBLBot User-agent: Diffbot User-agent: dotbot User-agent: EasouSpider User-agent: FreeFind User-agent: HaoSouSpider User-agent: ImagesiftBot User-agent: img2dataset User-agent: JikeSpider User-agent: magpie-crawler User-agent: Meltwater User-agent: MJ12bot User-agent: omgili User-agent: omgilibot User-agent: PetalBot User-agent: PiplBot User-agent: proximic User-agent: SeekportBot User-agent: Seekr User-agent: SemrushBot-SA User-agent: SeznamBot User-agent: SimplePie User-agent: SimplePie/1.1.3 (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20081219 User-agent: Sogou inst spider User-agent: Sogou web spider User-agent: spbot User-agent: Synthesio User-agent: Synthesio Crawler release MonaLisa (contact at synthesio dot fr) User-agent: VelenPublicWebCrawler User-agent: YisouSpider # AI training crawlers (pure extraction, no referral traffic) # NOTE: retrieval/answer crawlers that cite sources (PerplexityBot, # Perplexity-User, OAI-SearchBot, ChatGPT-User, DuckAssistBot, YouBot, # Claude-User, Claude-SearchBot) are intentionally NOT blocked so we stay # eligible for AI-answer referrals. User-agent: AI2Bot User-agent: Amazonbot User-agent: Applebot-Extended User-agent: Bytedance User-agent: Bytespider User-agent: CCBot User-agent: ClaudeBot User-agent: cohere-ai User-agent: FacebookBot User-agent: GPTBot User-agent: Kangaroo Bot User-agent: Meta-ExternalAgent User-agent: meta-externalagent User-agent: Meta-ExternalFetcher User-agent: Timpibot User-agent: Webzio-Extended Disallow: /