Block AI crawlers. Publish llms.txt.
Edit robots.txt and generate llms.txt from one screen. Control GPTBot, ClaudeBot and Googlebot individually or by group, plus per-page noindex.
Why both files
One screen for the two files machines actually read
Search engines have used robots.txt for decades. AI assistants now look for llms.txt, a plain Markdown guide telling them what a site is about and which pages matter.
Most plugins do one or the other. This one does both, without editing a file over FTP.
Control every crawler
Allow or block each bot, or a whole category in one click
This is the real thing — flip a switch and watch the served file change. Currently blocking 12 of 20 named crawlers.
The distinction that matters
Block AI training bots while keeping the assistants that actually cite you and send traffic. Most tools do not make that distinction — this one does, and it defaults to exactly that.
llms.txt
Generate it, or write your own
The plugin builds a clean /llms.txt from your published content, grouped by post type. Add a site summary and your own tips for AI assistants — guidance in your words, placed exactly where the convention expects it.
Prefer to hand-write the file? Upload or paste a complete robots.txt or llms.txt and it is served exactly as written.
- Generated from published content, grouped by post type
- Your own site summary and assistant guidance
- Or paste a complete file and serve it verbatim
- Respects site visibility — hidden sites publish nothing
Built to stay out of the way
Your visitors never pay for this plugin
- No CSS or JavaScript added to your front end
- No database queries added to a page view
- No external requests, no cookies, no data collection
- Virtual robots.txt — no file created, nothing to lose on migration
- Live preview that matches the served file byte for byte
The admin screen
Everything on one page
Honest limits
What this cannot do
Read this before you install
robots.txt asks compliant crawlers to behave; it does not enforce anything and does not protect private content. llms.txt is an emerging convention, and no AI service guarantees it will read it.
Free, and the source is public
In review on WordPress.org. Until it lands, install it from GitHub or read the code first.