What is llms.txt?
- One markdown file with your most important pages and a short description of each.
- Meant for language models with a limited context window: the essentials without the noise.
- Honest picture: Google ignores it for its AI features; for other assistants it is a cheap summary.
It gets searched for a lot and explained well surprisingly rarely: llms.txt. Some present it as the key to AI findability, others as hype that does nothing. The truth lies in between, and it can be told quite precisely, including what the file does and doesn't take care of for you.
What goes in an llms.txt
The file is deliberately simple: markdown, starting with the name of your site and a short description, followed by a structured list of your most important pages with one sentence of explanation per link. No scripts, no styling, no marketing: a table of contents for a reader who has no time.
That reader is a language model. An AI assistant that wants to understand your site can't always crawl and parse a hundred pages; an llms.txt gives it the essentials in a single file. Larger sites sometimes also add an llms-full.txt with the full text content of their most important pages, so a model doesn't have to plough through HTML, menus and cookie banners.
What it does do, and what it doesn't
First the honest side: llms.txt is a proposed standard, not an agreement. Nobody can guarantee you that an llms.txt leads to more citations. Anyone selling it as a miracle cure is exaggerating.
Google has now been explicit about it. Its guide to generative AI features (May 2026) states that Google treats llms.txt as an ordinary text file: it does not help you appear in AI Overviews or AI Mode. There, only plain good SEO counts. Other crawlers can still use the file.
Why we switch it on by default anyway: it costs nothing, it can't do any harm, and it solves a real problem. AI crawlers that do visit your site (and they demonstrably do, just look for GPTBot and ClaudeBot in your server logs) get the essentials in a readable form instead of a pile of HTML. Think of it as something for ChatGPT, Claude and Perplexity, not for Google.
How to set it up (and how not to)
By hand it is half an hour's work: create a text file, start with # Name of your site and a blockquote with one sentence about what you do, and below that, per section (## Products, ## Knowledge base), list your most important pages as markdown links with one sentence of explanation. Upload it to the root so it can be reached at /llms.txt.
The pitfall isn't creating it but keeping it up to date: an llms.txt that links to pages that no longer exist, or describes your old range, gives AI assistants exactly the wrong summary. That is why we generate it instead of writing it: on a Neuramerce site, llms.txt is built automatically from your real pages and updated with every change. The file can't go out of date because it isn't a separate file.
So: does your site need it?
If being found matters to you: yes, for the same reason as a sitemap. The investment is minimal, the risk is zero, and it prepares you for a search landscape in which a growing share of questions ends up with an AI assistant instead of ten blue links.
Do make sure the basics are in place first: an llms.txt that points to sloppy pages just summarises sloppiness. Work through the twelve basic tips first, and use the free site scan to check how readable your site currently is for search engines and AI alike.
Frequently asked questions
What is the difference between llms.txt and robots.txt?
Does llms.txt guarantee that ChatGPT will cite me?
Where do I put the file?
What is llms-full.txt?
Do I have to keep llms.txt up to date by hand?
