What is llms.txt, and should you bother?
In short
llms.txt is a short Markdown file at the root of a website that summarizes the site and links to its key pages for AI tools. It is a proposal from 2024, not a standard, and we found no major AI search engine saying it reads the file, so add one only if it takes you a few minutes.
llms.txt is a plain text file at the root of a website, at /llms.txt. It gives AI tools a short summary of the site and a list of its most useful pages. It is an emerging convention with no proven effect on AI search, so it is worth a few minutes at most.
That is our honest answer. The rest of this guide explains where the idea came from, how to write the file in ten minutes, and what to do first if you have limited time.
Where does llms.txt come from?
It was proposed by Jeremy Howard on 3 September 2024, and the proposal lives at llmstxt.org. Its stated aim is to "provide information to help agents use a website."
The thinking goes like this. Web pages are full of menus, scripts and adverts. An AI tool with limited reading space does better with a short, clean summary and a list of links to plain-text versions of the important pages.
The proposal is aimed at use on demand, when an AI agent needs facts while helping someone. Its authors write that they expected it to be useful "mainly for inference rather than training", meaning at the moment of answering. They also say it is used most heavily for software documentation, which coding agents follow.
What goes in an llms.txt file?
The format is ordinary Markdown, the same simple markup used in many README files. According to the proposal, the parts come in this order:
| Part | Required? | What it looks like |
|---|---|---|
| Name of the site or project | Yes | A level-one heading: # Harbour Bikes |
| One-line summary | No | A quote line: > Bike shop and repairs in Bristol, UK. |
| Extra notes | No | A few plain paragraphs or bullet points |
| Sections of links | No | ## Services followed by Markdown links, each with an optional note after a colon |
| An "Optional" section | No | ## Optional: links an agent can skip if it is short of space |
The proposal also suggests offering clean Markdown copies of key pages at the same address with .md added, for example /prices.html.md or /prices.md.
Can I see a complete example?
Here is a full file for a made-up bike shop. Replace the names and links with your own.
# Harbour Bikes
> Independent bike shop in Bristol, UK. We sell new and used bikes and repair all makes, usually the same day.
Open Tuesday to Saturday, 9:00 to 17:30. Phone +44 117 496 0000.
## Services
- [Repairs and servicing](https://www.example.com/repairs): what each service includes and prices
- [Bikes for sale](https://www.example.com/bikes): current stock with sizes and prices
- [Bike fitting](https://www.example.com/fitting): how a fitting works and how long it takes
## About
- [About us](https://www.example.com/about): who runs the shop and our mechanics' training
- [Contact and directions](https://www.example.com/contact)
## Optional
- [Blog](https://www.example.com/blog): maintenance tips and route guides
Save it as a plain text file named llms.txt and upload it to the root of your site, next to robots.txt. Check that https://yourdomain/llms.txt opens in a browser.
Do ChatGPT, Gemini or Perplexity read llms.txt?
As of November 2026, we could not find any statement from OpenAI, Google, Anthropic, Perplexity or Microsoft saying their AI search products read llms.txt or use it to choose sources.
What we did find points the other way, or says nothing:
- Google says you "don't need to create new machine readable files, AI text files, or markup" to appear in AI Overviews or AI Mode.
- OpenAI, Anthropic and Perplexity describe their crawlers and how robots.txt controls them on their crawler documentation pages. None of these pages mention llms.txt.
There is one interesting detail. The llmstxt.org site notes that the AI labs, linking to OpenAI, Anthropic and Gemini, publish llms.txt files for their own developer documentation. That shows the companies find the format handy for docs. It does not show their search crawlers read your file.
So should I bother?
It depends on what kind of site you run.
- Software, APIs and documentation sites: yes, probably. The proposal's authors say coding agents are the heaviest users today.
- Small business sites: only if it takes you ten minutes and the important things are already done. It will not hurt, and it forces you to write a clear one-line summary of your business, which is useful anyway.
- Large shops and publishers: low priority. Your time is better spent on crawler access, page speed and clear product or article pages.
Our view: llms.txt is cheap insurance in case it catches on. Do the basics first.
What should I do before writing llms.txt?
Do these first. Each one has documented effects, unlike llms.txt:
- Make sure AI search crawlers are allowed in robots.txt. See AI crawlers and robots.txt.
- Make sure your main text is in the page code, not only drawn by scripts.
- Rewrite the opening two sentences of each main page so they answer its main question.
- Show your business name, address, phone and hours as text.
- Add structured data that matches the page. See structured data explained.
Our free scanner checks all five, and notes whether you have an llms.txt file. That llms.txt check is information only and never lowers your score, because its benefit is unproven. The methodology page explains why.
Frequently asked questions
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may visit, and the main AI companies document how their bots treat it. llms.txt is a suggested reading guide with no official support from AI search engines that we could find.
Can llms.txt block AI tools from using my content?
No. It has no allow or block rules. Use robots.txt for that.
Will adding llms.txt hurt my SEO?
We know of no reason it would. It is a plain text file that search engines may index like any other.