// FREE TOOL
Free llms.txt generator
The Toffyjar llms.txt generator is a free tool that creates an llms.txt file for your website in under a minute. Enter your domain and it reads your robots.txt and sitemap, picks up to 24 key pages and writes a ready-to-upload file in the llmstxt.org format, with each link described by its page title and meta description.
By Nikhil Narasipura Doddamane, Founder & Head of SEO/GEO · Updated
Review the text, then upload it as llms.txt to your site root so it loads at yourdomain.com/llms.txt.
QUICK ANSWER
What is an llms.txt file?
An llms.txt file is a plain Markdown file at the root of a website (/llms.txt) that gives large language models a short, curated map of the site: the site name as an H1, a one-line summary, and grouped links to the most useful pages with a short description of each. The format was proposed by Jeremy Howard in September 2024 at llmstxt.org. It complements robots.txt and sitemap.xml rather than replacing them: robots.txt says what crawlers may fetch, the sitemap lists every URL, and llms.txt points AI tools to the pages that best explain what you do. For example, a 40-page agency site might list its homepage, 5 service pages, pricing, about, contact and its 10 strongest guides, roughly 20 links in total. Because the file is plain Markdown, it is small, usually under 5 KB, and quick for any model to read in a single request.
HOW IT WORKS
How does this llms.txt generator work?
- Discover. It reads your robots.txt for Sitemap lines, then falls back to /sitemap_index.xml, /sitemap.xml and /wp-sitemap.xml.
- Select. It prefers shallow URLs (home, services, pricing, about, hubs) and fetches up to 24 of them, skipping pages marked noindex.
- Describe. Each link uses the page title and meta description, so better meta descriptions give a better file.
- Group. Links are grouped by top-level folder (Main pages, Blog, Services and so on), with an Optional section pointing to the full sitemap.
The result follows the llmstxt.org structure: # Site name, a > summary line, then ## Section lists of - [Title](URL): description. In practice, a typical WordPress site with Rank Math or Yoast takes 15 to 25 seconds, because the generator reads each page live rather than from a cache.
BEST PRACTICE
What should a good llms.txt include?
| Part | What to write | Tip |
|---|---|---|
| H1 | Your brand name | Use the same name as your Organization schema |
| Summary | One sentence: who you are, what you do, for whom | Write it so an assistant could quote it |
| Main pages | Services, pricing, about, contact | Pages that answer buying questions |
| Guides | Your best explainers and comparisons | 10 to 30 links is plenty |
| Optional | Sitemap, docs, archives | Lower-priority material goes here |
Keep it current: update the file when you launch or retire a key page. Toffyjar publishes its own at toffyjar.com/llms.txt.
LIMITS
Does llms.txt improve AI visibility on its own?
No single file guarantees citations. As of October 2026, llms.txt is a community proposal, not a standard that every AI company has committed to read. It is cheap to publish and helps tools that do read it; for example, several AI coding assistants and documentation tools already fetch it. AI visibility still depends on crawl access for AI bots in robots.txt, clear structured data, and pages with specific, quotable answers. Check those with the free AI visibility checker, or see how Toffyjar handles them in generative engine optimization.
FAQ
Frequently asked questions
Is this llms.txt generator free?
Yes. The Toffyjar llms.txt generator is a free tool with no sign-up, no paywall and no account. It does not store the sites you check: each run fetches your robots.txt, sitemap and up to 24 pages, builds the file in memory and returns it to your browser. To keep it fast for everyone, each visitor can run it up to 12 times an hour. For example, a 40-page WordPress site usually finishes in 15 to 25 seconds, because the generator reads every page title and meta description directly from your live site rather than from a cached index.
Where do I upload llms.txt?
Upload llms.txt to the root of your domain so it loads at yourdomain.com/llms.txt, the same folder that holds robots.txt. On WordPress there are three common routes: upload the file by SFTP, use your host's file manager (cPanel, Plesk or hPanel), or let an SEO plugin such as Rank Math or Yoast serve it for you. On Webflow and Framer, add it through the hosting or redirect settings, or host it on a subdomain and redirect. After uploading, open the URL in a private browser window to confirm it returns HTTP 200 and plain text, not a 404 page or a login screen.
What is the difference between llms.txt and llms-full.txt?
llms.txt is a short index: an H1 with your brand name, a one-line summary and grouped links with a short description of each page. llms-full.txt is an optional companion file that contains the full text of your key pages in one Markdown document, so a language model can read everything in a single request without following links. Documentation sites from companies such as Anthropic and Cloudflare publish both. For most business websites, llms.txt alone is enough; add llms-full.txt when you have detailed guides, documentation or pricing pages you want AI tools to read in full.
Why are some of my pages missing?
The generator fetches up to 24 pages per run and prefers shallow URLs, such as /pricing/ or /services/, over deep ones like /blog/2024/05/post/. It skips pages marked noindex, pages that answer with anything other than HTTP 200, and URLs on other domains. If your sitemap lists hundreds of posts, many of them will be summarized by the Optional link to your full sitemap rather than listed one by one. That is by design: llms.txt works best as a curated list of 10 to 30 links. Add any missing key pages by hand before you upload the file.
Will llms.txt replace robots.txt or my sitemap?
No. Each file does a different job. robots.txt is the access rule book: it tells crawlers such as Googlebot, GPTBot, ClaudeBot and PerplexityBot which paths they may fetch. sitemap.xml is the full inventory: it lists every indexable URL so search engines can discover and recrawl them. llms.txt is the curated guide: it points language models to the 10 to 30 pages that best explain your business. If robots.txt blocks an AI crawler, llms.txt cannot override that block, so check crawler access first with the free AI visibility checker.
NEXT STEP