# robots-ai.txt for Cordley Solutions # Spec: https://www.ai-visibility.org.uk/specifications/robots-ai-txt/ v1.7.1 # Companion to /robots.txt for AI-specific crawlers. Standard robots.txt syntax, # plus the v1.7.1 Discovery: directive that advertises every AI Discovery file # on the same host. # Last-Updated: 2026-07-18 User-agent: * Allow: / # OpenAI User-agent: GPTBot Allow: / Crawl-delay: 1 User-agent: ChatGPT-User Allow: / Crawl-delay: 1 User-agent: OAI-SearchBot Allow: / Crawl-delay: 1 # Anthropic User-agent: ClaudeBot Allow: / Crawl-delay: 1 User-agent: Claude-User Allow: / Crawl-delay: 1 # Google User-agent: Google-Extended Allow: / # Apple User-agent: Applebot-Extended Allow: / # Perplexity User-agent: PerplexityBot Allow: / Crawl-delay: 1 # Meta User-agent: meta-externalagent Allow: / # Common Crawl User-agent: CCBot Allow: / # Cohere User-agent: cohere-ai Allow: / # You.com User-agent: YouBot Allow: / Sitemap: https://www.cordleysolutions.co.uk/sitemap.xml # AI Discovery file index (v1.7.1 Discovery: directive). Each URL is absolute, # on the same host, and resolves 200 OK. AI consumers can fetch any of these # to learn about this business as a structured entity. Discovery: https://www.cordleysolutions.co.uk/llms.txt Discovery: https://www.cordleysolutions.co.uk/llms.html Discovery: https://www.cordleysolutions.co.uk/ai.txt Discovery: https://www.cordleysolutions.co.uk/ai.json Discovery: https://www.cordleysolutions.co.uk/identity.json Discovery: https://www.cordleysolutions.co.uk/brand.txt Discovery: https://www.cordleysolutions.co.uk/faq-ai.txt Discovery: https://www.cordleysolutions.co.uk/developer-ai.txt