GEO
llms.txt: The Complete Guide to AI Search Visibility (2026)
llms.txt is a plain markdown file placed at the root of a domain that tells AI language models what the site is about, which pages are authoritative, and how the content should be interpreted.
robots.txt controls access. llms.txt controls understanding. Only around 9% of audited sites have one, which makes it one of the cheapest GEO advantages still available.
Free tools used in this guide
Why Does llms.txt Matter?
AI systems retrieve fragments of pages, not whole websites. Without guidance they must infer your site's purpose from whatever fragment they land on.
An llms.txt file gives them a curated map: the mission of the site, the pages worth citing, and the pages that should not be treated as authoritative.
It does not guarantee citation. It removes ambiguity, which is the main reason good pages get skipped.
What Is the Correct llms.txt Format?
- Start with an H1 containing the site or brand name.
- Add a blockquote summarising what the site does in two or three sentences.
- Group key URLs under H2 sections with a short description after each link.
- Include an 'Optional' or 'Not for citation' section for low-value or transactional pages.
- Keep it under roughly 50 KB and update it whenever major pages change.
How Do You Create llms.txt in 10 Minutes?
Step 1 — List your best 20 pages
Pick the pages you would want an AI system to quote: guides, tools, documentation and trust pages.
Step 2 — Write one line per page
Format each entry as a markdown link followed by a colon and a factual one-line description.
Step 3 — Add site context
Open with what the site is, who runs it, when it was founded and what makes its data original.
Step 4 — Publish at the root
Upload to yourdomain.com/llms.txt and confirm it returns 200 with content-type text/plain or text/markdown.
Step 5 — Keep robots.txt aligned
Allow the citation bots — OAI-SearchBot, PerplexityBot, ClaudeBot, Google-Extended — or the file will never be read.
Does llms.txt Replace robots.txt or a Sitemap?
No. robots.txt grants or denies crawl access, the XML sitemap lists every indexable URL for search engines, and llms.txt curates a small set of pages with meaning attached for language models.
All three should exist and agree with each other. Contradictions — such as blocking a crawler you list in llms.txt — waste the effort entirely.
Frequently Asked Questions
Is llms.txt an official standard?
It is a community proposal from Jeremy Howard of fast.ai, adopted by several AI and developer-focused organisations. It is not yet an official requirement from any search engine.
Where do I put llms.txt?
At the root of your domain: yourdomain.com/llms.txt, served as plain text with a 200 status.
Will llms.txt get me cited by ChatGPT?
It improves comprehension and page discovery, but citation still depends on authority, accuracy and structure. Treat it as one signal among several.
Does llms.txt help traditional SEO?
Not directly — Google does not use it as a ranking signal. Its value is in how AI answer engines interpret and select your content.