Build a spec-compliant llms.txt index for your domain — site summary, sectioned links, and copy-ready output for AI crawlers and LLM agents. Free, no signup. Build an index AI agents can read at /llms.txt on your site — the same pattern AnyPost uses at anypost.md/llms.txt.
Generate from a domain or paste URLs to preview llms.txt here.
AnyPost publishes a living index for agents — docs, convert pages, guides, and free tools. Your file can follow the same shape.
# AnyPost
> Social post URLs → clean, LLM-ready Markdown. Domain swap on X, LinkedIn, Reddit, and more.
## Free tools
- [Free tools hub](https://anypost.md/free-tools): Compose, preview, llms.txt and DESIGN.md generators.
- [Compose editor](https://anypost.md/compose): Markdown → social posts for 12 networks.
## Docs
- [Documentation](https://anypost.md/docs): API reference and platform notes.
llms.txt at your site root so it is served at https://yoursite.com/llms.txt.text/plain; charset=utf-8 and a sensible cache header (for example one hour).The AnyPost llms.txt generator at anypost.md/free-tools/llms-txt-generator helps you publish a spec-compliant llms.txt file for your own domain. llms.txt is a proposed index (llmstxt.org) that lists the Markdown-friendly pages AI agents should read—product overview, documentation, pricing, and blog—at https://yoursite.com/llms.txt. The free builder collects your site name, a one-sentence blockquote summary, and sectioned links with optional descriptions. You can paste URLs manually or import discoverable pages from your public sitemap.xml without signing up. Output follows the same H1, blockquote, and ## section pattern AnyPost uses on its live anypost.md/llms.txt index. Host the file at your site root with text/plain, allow AI search crawlers in robots.txt, and refresh after major launches. Pair with structured data and clean docs for generative engine optimization alongside AnyPost’s social post to Markdown workflow.
llms.txt is a proposed standard (llmstxt.org) for a Markdown index at the root of your site — for example https://yoursite.com/llms.txt. It lists the pages AI agents should read to understand your product, docs, and pricing, without parsing heavy HTML.
robots.txt tells crawlers what they may fetch. llms.txt tells LLM-oriented agents which human-readable pages matter and how they are organized — closer to a curated table of contents than crawl rules.
No. We discover up to 200 URLs from your public sitemap (and robots.txt when needed), classify them into sections, and scrape up to twelve priority pages in parallel for titles, descriptions, and body text. Remaining links use path-based titles in the index. Pages behind login walls, heavy JavaScript shells, or bot checks may fail to scrape — the stats card shows how many succeeded.
llms-full.txt concatenates plain-text excerpts from successfully scraped pages (## title, URL, body per page). llms.txt is the short index with sectioned links and descriptions where scrape succeeded. Host both at your site root if agents need full context; many teams ship llms.txt first.
AnyPost publishes its own llms.txt at anypost.md/llms.txt — a living index of docs, convert landings, guides, and free tools. Use this generator to build a similar file for your domain.
XML sitemap? Sitemap generator · DESIGN.md for agents? DESIGN.md generator · Social post → Markdown? Live preview · Markdown → social? Compose