By Alex Morgan | Last Updated: May 2026
Disclosure: This page contains affiliate links. We may earn a commission if you purchase through our links at no extra cost to you. Read our full disclosure.
Key Takeaway: llms.txt is a plain-text file you add to your website that tells AI agents and language models what your site is about and where to find important content. Google’s Lighthouse now audits for it under “Agentic Browsing” — but Google Search separately says it’s not required for AI Overviews. Both statements are true. It takes two minutes to add and costs nothing. Add it anyway.
If you follow SEO news you may have seen some confusion around llms.txt in May 2026. Google’s Lighthouse tool now audits for it. Google’s Search team says you don’t need it. The SEO community is divided.
Here is the plain-English explanation of what’s actually happening and what you should do about it.
What Is llms.txt?
llms.txt is a plain-text file that sits at the root of your website — at yoursite.com/llms.txt — and provides a structured summary of your site specifically for AI language models and autonomous agents.
Think of it like robots.txt, which tells search engine crawlers what they can and can’t access. llms.txt tells AI systems what your site is about, where important content lives, and how to understand your site structure without having to crawl every single page.
The file uses simple Markdown formatting. A basic example:
# YourSite.com
A UK-based hosting review and SEO content site covering Namecheap,
Hostinger and web hosting for UK small businesses.
## Key sections
- [Namecheap Reviews](/namecheap-review-2026/): Complete review and pricing guides
- [Hosting Comparisons](/namecheap-vs-competitors-2026/): Side-by-side comparisons
- [AEO Guides](/what-is-answer-engine-optimisation-2026/): AEO guides
- [Free Tools](/aeo-score-checker/): Free AEO score checker
## About
Written by Alex Morgan, UK web developer with 8 years experience.That is a complete, functional llms.txt file. It took three minutes to write.
Why Is Everyone Talking About llms.txt in May 2026?
Two things happened in quick succession.
First, on May 5, 2026, Google added llms.txt to its Chrome Lighthouse toolset under a new “Agentic Browsing Audits” category. Lighthouse is the tool developers use to audit site quality — the same tool that checks page speed, accessibility, and Core Web Vitals. Adding llms.txt to Lighthouse signals that Google considers AI-agent readiness a legitimate site quality concern.
Second, around the same time, Google’s Search team published a new AI optimisation guide that explicitly listed llms.txt as something you do not need for AI Overviews or generative AI search features.
This created a confusing situation: one Google product audits for llms.txt, another Google product says it’s unnecessary.
Both statements are accurate — they’re just answering different questions.
The Confusing Bit — Google Search vs Google Lighthouse
Here’s why both Google teams are right without contradicting each other.
Google Search is talking about Search visibility — specifically whether llms.txt helps your content appear in Google AI Overviews, AI Mode, or traditional search results. The answer to that specific question is: no, llms.txt does not help with Google Search visibility. FAQ schema, Speakable markup, and quality content are what matter there.
Google Lighthouse is talking about something different — browser-agent readiness. Specifically, whether AI agents that autonomously browse websites (like Claude in Chrome, ChatGPT’s browsing agent, or the AI agents being built into browsers) can efficiently understand and navigate your site. For that purpose, llms.txt does help.
The practical distinction: Google Search is about being found. Agentic Browsing is about being usable once an AI agent arrives on your site.
Publishers and developers now need to separate Search visibility from browser-agent usability. llms.txt can remain irrelevant to one product lane and still help another.
Does Anyone Actually Use llms.txt?
The honest answer is: yes, more than most people think.
Anthropic explicitly recommends llms.txt in its Writing for Agents guidance. OpenAI uses it for its Agents SDK and the Agentic Commerce Protocol. Google itself has indexed between 30,000 and 60,000 llms.txt files globally according to Wix Studio AI Search Lab research.
That said, Google’s John Mueller has compared llms.txt to the keywords meta tag from the early 2000s — a file that technically exists but that search engines largely ignore for ranking purposes.
The honest verdict: llms.txt is not a ranking factor. It will not directly improve your Google rankings or AI citation rate tomorrow. But it is a two-minute implementation, it is now checked by Lighthouse, it is recommended by Anthropic and OpenAI, and the direction of travel is clearly toward AI-agent readiness becoming a real signal over the next 12-24 months.
Implement it because it costs nothing and takes two minutes. Not because it will transform your search visibility overnight.
How to Create an llms.txt File for Your WordPress Site
Creating a valid llms.txt file takes less than five minutes.
Step 1 — Create the file
Open a plain text editor (Notepad on Windows, TextEdit on Mac in plain text mode). Create a new file with your site summary in the format below.
Step 2 — The format
# [Your Site Name]
[One or two sentence description of what your site covers.]
## Key sections
- [Section Name](/your-url/): Brief description
- [Section Name](/your-url/): Brief description
- [Section Name](/your-url/): Brief description
## About
[Author name], [credentials]. [One sentence about expertise].Step 3 — Upload to your site root
The file must live at yoursite.com/llms.txt — not in a subfolder.
For WordPress: use a plugin like WP File Manager, or upload via FTP/cPanel File Manager directly to the public_html folder. Name the file exactly: llms.txt
Step 4 — Verify it’s accessible
Open a browser and go to yoursite.com/llms.txt. You should see your plain text content. A 404 error means the file isn’t in the right location.
Step 5 — Test in Lighthouse
Open Chrome DevTools (F12), go to the Lighthouse tab, run an audit with Agentic Browsing enabled. A properly set up llms.txt should pass.
llms.txt vs robots.txt vs sitemap.xml
These three files serve distinct purposes:
robots.txt — tells crawlers which pages to access or skip. A crawl permission file.
sitemap.xml — lists all your URLs to help search engines discover content efficiently.
llms.txt — tells AI language models and agents what your site is about and where key content lives. An orientation file for AI systems.
You need all three. robots.txt and sitemap.xml are essential for SEO. llms.txt is a two-minute add-on that future-proofs your site for the AI agent era.
Should You Add llms.txt to Your Site?
Yes — but with realistic expectations.
Add it because: it takes two minutes, Google Lighthouse now audits for it, Anthropic and OpenAI recommend it, and the direction of travel is toward AI agent readiness mattering more over time.
Don’t add it expecting: improved Google rankings, better AI Overviews visibility, or a sudden surge in ChatGPT citations. None of those are confirmed outcomes.
The correct framing: it’s a small hygiene task, like adding alt text to images. It doesn’t transform your visibility on its own. But it’s the right thing to do and costs nothing.
Quick llms.txt Template — Copy and Paste
# [Your Site Name]
[One or two sentence description of your site and who it's for.]
## Key sections
- [Section Name 1](/your-url/): Brief description
- [Section Name 2](/your-url/): Brief description
- [Section Name 3](/your-url/): Brief description
## About
[Author name], [role and credentials].
## Contact
[Optional: contact page URL]Fill in the brackets, save as llms.txt, upload to your site root. Done in two minutes.
Frequently Asked Questions
Does llms.txt help with Google SEO rankings? No. Google Search has explicitly stated that llms.txt is not needed for AI Overviews or any generative AI search feature. It will not improve your Google rankings directly.
Does llms.txt help with ChatGPT or Perplexity citations? Not in any confirmed, direct way. However, Anthropic and OpenAI both reference it in their agent documentation, suggesting it may play a role as AI agents become more prevalent.
What happens if I don’t add llms.txt? Nothing immediately. Google’s Lighthouse marks it as “Not Applicable” if absent — not as a failure. You won’t be penalised for not having one.
How often should I update llms.txt? Whenever you add major new content sections or significantly restructure your site. Quarterly updates are sufficient for most sites.
Can I block AI crawlers with llms.txt? No. llms.txt is an informational file, not a directive file. To block AI crawlers use robots.txt with specific directives for bots like GPTBot, ClaudeBot, and PerplexityBot.
Is llms.txt the same as robots.txt for AI? No — different purposes. robots.txt controls crawl access. llms.txt provides a content summary. You can and should have both.
Want to improve your full AI search visibility? Check your AEO score free at blogzenn.com/aeo-score-checker. To automate AEO signals on every article you publish, try RankFlow free — 3 articles, no card required.
