llms.txt, robots.txt & AI Crawlers: Small Business Guide (UK)
What llms.txt is, which AI crawlers to allow in robots.txt (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended) and a copy-paste template.
Two small files help AI read your site.
robots.txt
User-agent: OAI-SearchBot Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: * Allow: / Sitemap: https://example.co.uk/sitemap.xml
llms.txt
A short Markdown summary: who you are, what you do, where, prices, contact, key pages. See ours: /llms.txt and /llms-full.txt. It's a proposed convention, not a guaranteed ranking factor.
Related UK AI visibility guides
- How to get your business recommended by AI models (UK)
- Why ChatGPT isn't recommending your business (and how to fix it)
- AI search optimisation UK: A practical guide for local businesses
- How to get your business recommended by Perplexity, Gemini and Claude (UK)
- Generative engine optimisation (GEO) for UK small businesses
- How to get your business recommended by ChatGPT (UK)
- AI visibility for small businesses in the UK
- AI search optimisation for tradespeople
- GEO vs SEO explained
- How to get recommended by ChatGPT (UK, 2026)
- How to get recommended by Google Gemini (UK, 2026)
- How to get recommended by Perplexity (UK, 2026)
- How to get recommended by Claude (UK, 2026)
See whether AI models recommend your business today
We help businesses like yours across the UK get recommended by AI assistants like ChatGPT, Gemini, Perplexity and Claude. Run our free live 4-AI visibility check in 30 seconds (no sign-up). Want us to sort everything for you? Our AI Visibility Fix is £295 one-off, with optional £49/month monitoring.