LLMs.txt

What is LLMs.txt?

LLMs.txt is an emerging standard (like robots.txt but for AI) that tells large language models about your website's structure, content, and how to best understand it. Think of it as a "readme file" for AI — it provides context about what your site is about and which pages are most important.

While robots.txt controls which pages crawlers can access, llms.txt goes a step further: it actively helps AI engines like ChatGPT, Perplexity, Claude, and Google Gemini understand your content, prioritize your best pages, and represent your site more accurately in AI-generated answers.

How It Works

Prime SEO automatically generates two files for your site:

• yoursite.com/llms.txt — Standard version with site info and important page links
• yoursite.com/llms-full.txt — Extended version with actual page content for deeper AI understanding

Both files are generated dynamically on every request, so they are always up-to-date and require no manual maintenance. When you publish a new post or update a page, the changes are reflected immediately.

Under the hood, Prime SEO uses Dynamic Rewrites to serve these files. This means they work instantly after plugin activation — no need to flush permalinks or touch your .htaccess file.

Standard LLMs.txt

The standard llms.txt file contains a concise overview of your site:

• Site name and description — pulled from your WordPress settings
• Important pages — homepage, about, contact, and other key pages
• Latest posts — with titles and URLs
• Categories and tags — your content taxonomy structure
• Custom content — any additional context you add manually

It's lightweight and fast — perfect for AI crawlers that want a quick overview of your site without downloading every page. Think of it as your site's elevator pitch to an AI engine.

Full LLMs.txt (llms-full.txt)

The extended version includes everything from the standard file plus the actual content of your most important posts and pages:

• Full content of your most important posts and pages
• Formatted as clean, readable text — HTML tags are stripped, leaving only the content
• Configurable post count — choose how many posts to include (default: 100)
• Post type selection — choose which post types to include (posts, pages, products, etc.)

This gives AI engines a deep understanding of your content without requiring them to crawl your entire site page by page.

Customizing Content

Navigate to Prime SEO → AI Settings → LLMs.txt section to customize your file. You can:

• Edit the custom content that appears at the top of your llms.txt file
• The editor supports plain text format — write naturally, as if you were explaining your site to someone
• Add instructions, site description, or any context you want AI to know about your site

For example, you might write something like:

• What your business does and who it serves
• Which pages are most authoritative or frequently updated
• How your content is organized (blog categories, product lines, etc.)
• Any special instructions for how AI should interpret your content

Sections Configuration

Choose which sections to include in your generated llms.txt file:

• Site Info (name, description, URL) — always included as the foundation of your file
• Pages — your published pages with titles and URLs
• Posts — your blog posts, ordered by most recent
• Categories — your content taxonomy for structural context
• Custom content — your manually written text and instructions

Toggle sections on or off depending on what's relevant for your site. A small portfolio site might only need Site Info and Pages, while a large blog would benefit from including Posts and Categories as well.

Verifying Your Files

After configuring your LLMs.txt settings, verify that everything is working by visiting these URLs in your browser:

• yoursite.com/llms.txt — your standard LLMs.txt file
• yoursite.com/llms-full.txt — your extended version (if enabled)

Both files should display as plain text with your site information, content links, and any custom text you've added.

If you have caching enabled (via a plugin like WP Super Cache or a CDN like Cloudflare), you may need to purge your cache after making changes to see the updated files immediately.