# ════════════════════════════════════════════════════════════════════════════ # robots.txt · auditscale.eu · Generated 2026-05-24 # ════════════════════════════════════════════════════════════════════════════ # Policy: explicit welcome to both traditional and generative crawlers. # Coherent with AuditScale's core service (we sell AI visibility). # Pages with noindex (thank-you, legal pages) excluded via . # ════════════════════════════════════════════════════════════════════════════ # Traditional crawlers (Google, Bing, etc.) User-agent: * Allow: / # ─── Generative AI crawlers (explicit allow) ─── # To block any of these in the future, change "Allow: /" to "Disallow: /". User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / User-agent: meta-externalagent Allow: / # Sitemap location (auto-discovery) Sitemap: https://www.auditscale.eu/sitemap.xml