Does Your Website Need an llms.txt File?

What is an llms.txt file?
An llms.txt file is a proposed Markdown overview that helps an AI agent find selected website resources. It is a navigation aid, not a permission system; no engine promises to cite you for publishing one. In BaaDigi's 1,429 collected AI answers (Aug 18–31 2026), citations went to ordinary pages that answered the question, reddit.com 657 times. Publish one when you have public material to organize and someone to maintain it.
For a service business, the decision should be proportional to the need. Correct service pages and working contact details take priority over publishing a file for its own sake. A documentation-heavy business may have a clearer use case than a small site whose navigation is already straightforward. This guide distinguishes the current proposal, a specific Lighthouse check and a sensible maintenance process. A valid-looking file should never be sold as proof that your business is ready for every AI system.
Can an AI agent actually use your website?
AI agents are starting to visit sites on a customer's behalf — comparing companies and requesting quotes. We run the same agentic browsing checks Google built into Chrome and show you what an agent hits when it lands on your site. No email to run it.
By Ryan Goering, founder and CEO of BaaDigi, a contractor marketing agency.
Last updated: September 2026. We are evaluating a proposed convention here, not claiming that our clients gain citations simply by adopting it.
What does the current proposal specify?
The llms.txt v2 proposal, updated August 2026, supports a file at the root or a subpath such as /docs/llms.txt. Its only required section is an H1 naming the site or project. It describes optional summaries and sections linking to supporting material, and recommends links to agent-friendly content such as Markdown versions.
That distinction matters when reviewing old advice. “It must be at the root or it cannot be found” is too broad for the current proposal. Likewise, a particular checker’s rules should not be presented as the proposal itself. Ask which specification and tool version a vendor is using.
How is it different from other website files?
Keep the business purpose of each mechanism clear. Adding one does not repair the absence or misuse of another.
| Mechanism | Practical role | Do not use it as |
|---|---|---|
| llms.txt overview | A curated guide to useful public resources. | A guarantee of citation or complete site coverage. |
| robots.txt rules | Instructions for compliant automated crawling. | Authentication for private material. |
| Public site navigation | A route for visitors to find services and next steps. | Something that can be neglected after adding an AI file. |
| Business source of truth | The approved facts used to maintain public content. | A public dump of internal records. |
For crawler preferences, use the separate AI crawler controls guide. This article does not recommend changing training preferences merely because you decide to publish a resource overview.
What would a useful business example look like?
The following is an illustrative structure using example.com, not a claim about a real contractor. Replace it only with accurate descriptions and working public destinations that you own or have selected deliberately.
# Example Service Business
> Public information about services and contacting the team.
## Services
- [Service overview](https://example.com/services): Work the business offers.
- [Service area](https://example.com/service-area): Places the team actually serves.
## Contact
- [Contact details](https://example.com/contact): Current ways to reach the office.
Do not copy the example as evidence that your own file is complete. The editorial question is whether each link gives an agent useful, accurate information. If your CMS offers maintained Markdown versions, evaluate those destinations. Do not invent alternative URLs that the server does not provide.
Keep promotional language out of the resource descriptions. A label explaining the page’s purpose is more useful than an unsupported claim that the business is the best in its region.
Is your own website costing you leads?
Free scan — speed, mobile, local visibility, and lead capture. Results in about 30 seconds.
What does Lighthouse currently check?
Chrome’s current Lighthouse documentation says the audit flags server errors when retrieving llms.txt and treats a missing file returning 404 as not applicable. That documented check does not establish that a file has accurate prices, safe links or comprehensive business information.
Keep technical and editorial checks separate. A tool may successfully retrieve a file that links to obsolete pages. A file may be absent without indicating a broken customer journey. Read the actual result instead of turning every missing item into a sales emergency.
Ask for the test name, version, tested URL and output when someone reports a failure. If another tool uses additional validation, describe those checks as that tool’s behavior. Do not generalize one implementation into an industry requirement.
How should you review a file before publication?
Assign an owner and test the actual destinations. Our recommended review focuses on usefulness and maintenance rather than satisfying a decorative score.
- Confirm that the name and summary accurately describe the business.
- Choose a small set of resources that answer meaningful questions.
- Open every destination and remove broken, obsolete or unintended links.
- Check that no private customer or operational material is exposed.
- Confirm the live file is served as intended rather than a branded error page.
- Record who updates it when services or URLs change.
If the file is generated automatically, inspect the output rather than assuming the generator selected the right pages. A long list of everything on the site can make a curated resource less useful.
When is creating one worth the work?
Create it when you can state who or what will use it, what information it will organize and how it will be maintained. Defer it when the site’s core service facts are wrong or the effort displaces a more consequential repair.
Google says its AI search features do not require special AI text files. Do not interpret publishing llms.txt as purchasing search eligibility. Our own citation sample points the same way: across 1,429 answers from ChatGPT, Perplexity and Google AI Overviews, the most-cited domains were reddit.com (657), baadigi.com (382), google.com (310), linkedin.com (291) and youtube.com (289). That sample measures cited pages, not files, and it rewards pages that answer a question plainly. The LLM SEO guide covers that page format; the citation study has the full table. The AI visibility check observes answers; that is a separate question from whether a resource file exists.
Our SEO service can help prioritize site work. If you need a wider review of one business and one market, BaaDigi’s AI Visibility Audit is $497. Its value should be a useful diagnosis, not an oversized invoice for a small text file.
Who should maintain the file after launch?
Assign it to the person who maintains the linked public information. When a service, policy or page changes, check its entry and destination at the same time. Remove stale links rather than preserving them to make the file look comprehensive. If nobody will maintain it, prioritize accurate ordinary pages first. Use the website task checklist to test the actual customer action instead of treating file publication as acceptance.
Free website audit — see what's costing you leads
No email required. Takes 2 minutes. Completely free.

Ryan Goering
CEO & Founder, BaaDigi
U.S. military veteran and digital marketing strategist who built BaaDigi to help contractors generate predictable leads and revenue. 15+ years in SEO, PPC, and AI-powered marketing automation.
Frequently Asked Questions
Should I treat a missing llms.txt file as an urgent defect?▼
No. Lighthouse treats a missing file as not applicable. A broken service page or exposed private data is urgent; an absent optional overview is not.
Can I include internal documents to give an agent more context?▼
No. Keep the public file limited to information intended for public use. Do not list customer records, private estimates, internal credentials or other sensitive resources. Review every destination before publishing and keep access controls separate.
How do I evaluate an automatically generated llms.txt file?▼
Read it as an editorial document, not a successful job. Check the business description, the selected pages and the link destinations. Remove obsolete resources and confirm any alternative page formats actually exist. Assign an owner for changes.
What should I ask a provider selling an llms.txt service?▼
Ask exactly what they will produce, which pages they will list and why, who maintains the file when a service or URL changes, and which specification and tool version they validated against. Then separate the deliverable from the promise. Publishing a file is something a provider can verify; controlling a search answer is not. Google says its AI features need no special file, and in our 1,429 collected AI answers (Aug 18–31 2026) the cited pages were ordinary public content that answered a question, led by reddit.com with 657 citations. If the pitch leans on citations rather than on a clean, maintained overview, weigh the fee against more pressing site needs such as a broken booking path or missing service pages.
Popular Contractor Marketing Guides
HVAC SEO by City
We serve contractors nationwide — based in Orange County, CA
Explore More Topics
Ready to Get More Leads?
Get a free marketing audit for your contracting business. We'll show you exactly where you're losing leads.
Get Your Free AuditRelated Articles
LLM SEO? What Will They Think of Next?
LLM SEO is the work that gets your page quoted inside an AI answer instead of listed under it. Here is what it changes for a contractor site, what it does not, and what our own 1,429-answer tracker showed.
Does ChatGPT SEO Exist? What Gets a Contractor Named
ChatGPT SEO is real but it is not Google SEO with a new name. Our tracker shows ChatGPT cites a different set of sources from Perplexity and AI Overviews. Here is what that means for a contractor site.
AEO vs SEO: Is AEO Replacing SEO for Contractors?
AEO is commonly used to describe work intended to make information useful in answer-based discovery, while SEO addresses visibility in search. For contractors, the practical work overlaps: accurate service information, useful pages and a dependable customer path. Add AI-specific observation where it informs decisions, but do not buy a claim that ordinary SEO has become irrelevant.