llms.txt is a plain Markdown file at the root of your website (yoursite.com/llms.txt) that gives AI systems a curated summary of your business and a guided list of your most important pages. Major AI crawlers don't reliably read it yet, and studies show no measurable citation boost — but it costs about 30 minutes, AI agents and coding tools already use it, and adoption is growing. Verdict: worth shipping as cheap insurance, not as a magic bullet.
Every few months, a new file lands in the "should my website have this?" conversation. In 2026, that file is llms.txt. Some marketers call it the new robots.txt. Others call it a waste of time. As usual, the truth sits in the middle — and the data tells us exactly where.
This guide covers what llms.txt actually is, what the adoption numbers show, how it differs from robots.txt, and a copy-paste template you can adapt for your business today. It's part of our AI visibility series — start with AEO vs GEO vs SEO: What's the Difference? if those terms are new to you.
Why does AI visibility suddenly matter so much?
Because the audience moved. The numbers below are why "being readable by AI" went from a nerdy footnote to a business concern:
In short: a large and growing share of your potential customers now gets answers from AI tools. The question is whether those tools can find, understand, and accurately describe your business. That's the problem llms.txt tries to help with.
What is an llms.txt file?
llms.txt is a plain Markdown file placed at the root of your domain — for example, nexum-sol.com/llms.txt — that gives AI systems a curated, human-written overview of your site. It was proposed in September 2024 as a way to hand AI tools your most important content in a format they can digest easily, instead of forcing them to parse heavy HTML, menus, and scripts.
A typical llms.txt contains three things:
- A title — your business name as an H1.
- A summary paragraph — what you do, who you serve, where you operate.
- Curated link sections — your key pages as Markdown links, each with a one-line description.
Think of it as a welcome guide for AI: "Here's who we are, and here are the five pages that matter."
llms.txt vs robots.txt: what's the difference?
robots.txt controls access; llms.txt adds curation. robots.txt tells crawlers which URLs they may or may not visit — it's the gate. llms.txt tells AI systems which pages matter most and how to understand your brand — it's the tour guide. They coexist rather than compete.
| robots.txt | llms.txt | |
|---|---|---|
| Job | Permission — who may crawl what | Curation — what matters and what it means |
| Format | Directive syntax (User-agent, Disallow) | Plain Markdown |
| Status | Universal web standard since 1994 | Community proposal (Sept 2024), not formally standardized |
| Who respects it | Virtually all major crawlers | Partial — AI agents & some platforms; major training crawlers inconsistently |
| Impact if missing | Crawlers assume everything is allowed | AI tools parse your site the hard way |
Does llms.txt actually work? The honest data
Here's where most articles oversell. The evidence as of mid-2026:
- Adoption is around 10%. SE Ranking's study of roughly 300,000 domains found a 10.13% adoption rate, spread almost evenly across low-, mid-, and high-traffic sites.
- No measurable citation boost — yet. In the same research, a machine-learning model predicting AI citations actually improved when the llms.txt variable was removed — meaning the file currently adds no detectable signal to whether AI tools cite you.
- Major training crawlers don't reliably fetch it. Google has publicly downplayed the file, comparing it to the old keywords meta tag.
- But serious companies ship it anyway. Anthropic, Stripe, Cursor, and Cloudflare all publish one, and by early 2026 adoption had spread from developer tools into mainstream SaaS and publishing.
llms.txt is a low-cost, low-yield bet with real optionality. It won't move your rankings or AI citations today. But it takes 30 minutes, AI agents already use it, and if a major AI platform formally adopts it tomorrow, you're already in position. Ship it — just don't expect miracles, and don't let it distract you from the work that does move AI visibility: structured content, schema, and brand mentions.
So what actually moves AI visibility?
If llms.txt is the cheap insurance, this is the real engine. Research on AI citations consistently points to the same levers:
- Content with statistics, citations, and quotations earns 30–40% higher visibility in AI responses than vague content (Superlines, 2026). AI systems prefer quoting pages that state concrete facts.
- Freshness matters: pages updated within the last 2 months earn roughly 28% more AI citations than stale ones.
- Don't block the crawlers. If your robots.txt blocks GPTBot, ClaudeBot, or PerplexityBot, AI tools simply cannot read or cite you. For a business that wants customers, these crawlers should be allowed.
- Answer-first structure wins. Question headings with direct 40–60 word answers underneath — the same AEO format we use across this blog.
That's why llms.txt should be the last 30 minutes of your AI visibility work, not the first.
Get the full AI visibility playbook
Our free guide covers all of it — schema, content structure, crawler settings, and llms.txt — written for SMEs, no jargon.
✓ Check your inbox — your guide is on the way!
We respect your privacy. Unsubscribe at any time.
How to create your llms.txt file (copy-paste template)
Create a plain text file named llms.txt, paste the template below, replace the placeholders with your business details, and upload it to your website's root folder so it loads at yoursite.com/llms.txt. Here's what ours looks like:
# Nexum-sol > Nexum-sol is a Lagos-based technology company offering website > development, digital marketing, business consultancy, and technical > training for SMEs in Nigeria and worldwide. Founded as a freelance > practice in 2019 and incorporated in 2025. Tagline: We Build. You Grow. ## Services - [Website Development](https://nexum-sol.com/services.html#websites): Business websites from ₦200,000, built for speed, SEO and AI visibility - [Digital Growth Suite](https://nexum-sol.com/services.html#digital-growth): SEO, AEO/GEO, content marketing, and paid advertising - [Business Consultancy](https://nexum-sol.com/services.html#consultancy): Digital strategy and systems for growing businesses - [Technical Training](https://nexum-sol.com/services.html#training): Hands-on training in web, marketing, data and automation tools ## Key Pages - [About](https://nexum-sol.com/about.html): Company story, mission and team - [Portfolio](https://nexum-sol.com/portfolio.html): Client projects and case studies - [Blog](https://nexum-sol.com/blog.html): Guides on SEO, AI search and business growth - [Contact](https://nexum-sol.com/contact.html): Get in touch — Lagos, Nigeria ## Optional - [Privacy Policy](https://nexum-sol.com/privacy.html) - [Terms of Service](https://nexum-sol.com/terms.html)
Three rules when adapting it:
- Keep the summary factual and specific. Location, services, pricing signals, founding year — concrete facts AI can repeat accurately.
- Curate, don't dump. 8–15 links to pages that genuinely represent your business beats a full sitemap.
- Use absolute URLs (full https:// addresses), one per line, each with a one-line description after the colon.
One more file to check: your robots.txt
While you're at it, confirm your robots.txt isn't accidentally blocking the AI crawlers you want to be visible to. For a customer-seeking business, your robots.txt should allow these user-agents (blocking is mainly for publishers protecting paid content):
# Allow AI crawlers — required for visibility in AI answers User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: /
This single check matters more than llms.txt itself: a blocked crawler can never cite you, no matter how good your content is.
Frequently asked questions
What is an llms.txt file?
llms.txt is a plain Markdown file placed at the root of your website (yoursite.com/llms.txt) that gives AI systems a curated summary of your business and links to your most important pages with one-line descriptions. Proposed in September 2024, it acts like a welcome guide for AI tools.
Is llms.txt the same as robots.txt?
No. robots.txt controls access — which URLs crawlers may visit. llms.txt adds editorial curation — which pages matter most and how your brand should be understood. They solve different problems and work together: robots.txt is the gate, llms.txt is the tour guide.
Do AI tools like ChatGPT actually read llms.txt?
Inconsistently. As of 2026, major LLM training crawlers don't reliably fetch llms.txt, and studies have found no measurable citation improvement from having one. However, AI coding agents and some platforms do use it, support is growing, and it costs under an hour — which is why companies like Anthropic and Stripe publish one anyway.
How do I create an llms.txt file?
Create a plain Markdown text file with an H1 title (your business name), a one-paragraph summary of what you do, and H2 sections listing your key pages as Markdown links with one-line descriptions. Save it as llms.txt and upload it to your website's root directory.
Does llms.txt improve SEO rankings?
No. llms.txt has no effect on Google rankings, and Google has publicly downplayed the file. Its purpose is AI visibility, not search rankings. For rankings, focus on traditional SEO; treat llms.txt as a low-cost extra layer for AI assistants and agents.
Should I block AI crawlers like GPTBot in robots.txt?
For most businesses seeking customers, no. Blocking GPTBot, ClaudeBot, or PerplexityBot removes your site from the sources AI tools can read and cite — making you invisible in AI answers. Blocking mainly makes sense for publishers protecting paid content.
References & sources
- Howard, J. — The /llms.txt file: official proposal & specification, llmstxt.org (September 2024)
- OpenAI — ChatGPT weekly active user announcements (Dec 2024, Feb 2025, Feb 2026), as compiled in AI Search Statistics 2025–2026, Omnibound
- SE Ranking — llms.txt adoption study, ~300,000 domains, as reported in Should Websites Implement llms.txt in 2026?, LinkBuildingHQ
- Codersera — llms.txt Explained: The Honest Guide to the Spec, Adoption, and How to Ship One (May 2026)
- Presenc AI — State of llms.txt 2026: Adoption, Standards, and Practice (April 2026)
- Conductor — 2026 AI Overview Benchmarks (21.9 million queries) and Superlines — citation & freshness research, via AI Search Statistics 2026, Superlines
- Adobe Digital Insights — AI referral traffic & conversion analysis (January 2026), via Omnibound AI Search Statistics
- Google Search Central — Robots.txt Introduction and Guide