# Fulcrum Group — robots policy # Last reviewed: 2026-05-04 # # Standard search engine crawlers: allowed fully (UTM-tagged URLs included; the # canonical link in handles deduplication). # AI crawlers that power search-result overviews and cite sources: allowed. # AI crawlers that ingest content to train foundational models: blocked. # Usage of this site for AI training without prior written permission from # Fulcrum Group Ltd is prohibited. See /terms/ for the full policy. # ─── Standard search engines (full crawl allowed) ────────────────────────── User-agent: * Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /preview/ Disallow: /staging/ Disallow: /newsletter/confirm/ Disallow: /newsletter/unsubscribe/ # ─── AI overview & search-citing bots (indexing, not training) ───────────── User-agent: Google-Extended Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: YouBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: DuckAssistBot Allow: / User-agent: BraveBot Allow: / # ─── AI training crawlers (blocked) ──────────────────────────────────────── User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Omgilibot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: AmazonBot Disallow: / User-agent: TimpiBot Disallow: / Sitemap: https://fg-uk.com/sitemap.xml