What is llms.txt?
llms.txt is a plain-text Markdown file placed at the root of a website that tells AI models what the site contains and which pages matter most. It was proposed by Jeremy Howard of Answer.AI in September 2024 as an AI-era counterpart to robots.txt — guidance for language models rather than crawler permissions.
Updated
Why does llms.txt matter for your site?
The honest position on llms.txt is that adoption is voluntary and unproven. No major assistant has publicly confirmed reading it, and Google’s John Mueller has said Google does not use it. It costs almost nothing to publish, which is the real argument for it: a cheap option on a standard that may matter later.
What does it cost to ignore it?
Very little, which cuts both ways — skipping llms.txt costs you almost nothing today, and any vendor selling it as the reason you are invisible in AI search is selling you the cheapest item on the list instead of the work that moves citations.
Which engine fixes this?
llms.txt is addressed inside The Stability Engine.
See what The Stability Engine includesCommon questions
Does llms.txt actually do anything?
There is no public confirmation from OpenAI, Anthropic, or Google that they read it, and Google has said it does not. Treat llms.txt as a low-cost bet on an emerging standard, not as a fix. If a page is not being cited, the cause is almost always the content itself — no answer in the first 60 words, no verifiable numbers — not a missing text file.
How is llms.txt different from robots.txt?
robots.txt controls access: which crawlers may fetch which paths. llms.txt is about comprehension: it points a model at the pages that best explain what you do, in Markdown it can read directly. robots.txt is honoured by every major crawler and genuinely matters. llms.txt is optional and currently unenforced.
Sources
Ryan Goering
CEO & Founder, BaaDigi
U.S. military veteran and digital marketing strategist who built BaaDigi to help contractors generate predictable leads and revenue. 15+ years in SEO, PPC, and AI-powered marketing automation.