Free tool

Sitemap ↔ llms.txt gap

Compare crawlable URLs vs what you expose to agents in llms.txt.

https:// is added automatically if you omit it. Instant teaser — email unlocks the full deliverable.

What this tool does

Your XML sitemap tells crawlers what exists. llms.txt tells agents what matters. When those diverge, agents miss your best pages — or get flooded with noise.

Why it matters

A gap report shows URLs in the sitemap that never appear in llms.txt (and vice versa), so you can curate deliberately.

How it works

  1. We fetch sitemap signals and llms.txt when present.
  2. We highlight obvious gaps.
  3. Email unlocks the full gap report.

Tips

  • Curate 5–20 links in llms.txt — not your entire sitemap.
  • Exclude staging and parameterized URLs.
  • Re-run after docs IA changes.

FAQ

What if I have no sitemap?

Publish one (or use your CMS default), then re-run. Agents and search both benefit.

Related tools

  • llms.txt generatorDetect /llms.txt and generate a ready-to-publish draft from your homepage.
  • AI Ready scannerScore any site for AI findability — llms.txt, continuation, and trust signals.
  • AI robots.txt builderAudit robots.txt for GPTBot, ClaudeBot, and friends — then download an allow-list draft.