What llms.txt is
llms.txt is a proposed standard, published by Jeremy Howard of Answer.AI at llmstxt.org in September 2024. The idea is simple: put a short Markdown file at /llms.txt that tells a language model what your site is and which pages matter, with links. Web pages are full of navigation, scripts and ads; a curated list is easier for a model to use inside a limited context window.
The format
The spec defines a fixed order. This generator follows it:
- An H1 with the site or project name. This is the only required part.
- A blockquote summary: one or two sentences with the key facts.
- Optional paragraphs or lists with more detail, with no headings.
- H2 sections, each a list of links in the form
- [title](url): notes. - A section named Optional holds links a tool can skip when it needs a shorter context.
# Acme Invoicing
> Invoicing software for freelancers.
## Docs
- [Getting started](https://acme.example/docs/start.md): Set up and send a first invoice
## Optional
- [Blog](https://acme.example/blog)What it does and doesn’t do
Adoption is partial. Some AI coding assistants and agents read llms.txt when they’re pointed at a site, and several documentation platforms generate one automatically. The major AI search products haven’t said their crawlers use it to choose which sources to cite. There’s no evidence it affects Google rankings, and Google has said Search doesn’t use it.
So why bother? It takes ten minutes, it has no downside, and it forces a useful exercise: deciding which pages actually explain your product. We publish one generated from our page registry, so it never goes stale: launchranked.com/llms.txt.
What to put in it
- The pages that answer the basics: what it is, who it’s for, what it costs, how to start.
- Docs, pricing, comparisons and policies. Skip tag archives and thin pages.
- Factual notes after each link. Describe the page; don’t sell it.
- Absolute URLs. The spec also suggests offering clean Markdown copies of pages at the same URL plus
.md. - Update it when your key pages change, or generate it from your sitemap or CMS.