User-agent: * Allow: / Disallow: /admin/ Disallow: /images/2012/01/ Disallow: /images/template_* # AI / LLM crawlers User-agent: GPTBot Allow: / User-agent: Claude-Web Allow: / User-agent: Googlebot Allow: / Sitemap: https://www.james-herbert.co.uk/sitemap.xml LLMs: https://www.james-herbert.co.uk/llms.txt