llms.txt generator
Paste a domain. We fetch the homepage, parse the main pages, and generate a spec-compliant llms.txt you can drop into the root of your site. No email gate. No tracking beyond our own Statable.
Fetching and parsing pages...
Generated llms.txt
How this tool works
What we fetch
One HTTP request to your homepage, then up to 15 follow-up requests to internal links found there. We respect a 10-second timeout per request, use a plain user agent, and don't follow rel="nofollow" or off-domain links.
What we extract
Page title from the <title> tag, description from <meta name="description">, and the visible heading where available. Result is shaped to match the llms.txt v0 spec.
What we don't do
We don't store your domain or your generated file. We don't email-gate it. We don't render JavaScript, so single-page apps that need rendering for their content will produce a thinner result. If you need a full crawl with JS rendering, that's an audit engagement.
What happens after
Copy or download the result. Paste it as /llms.txt at the root of your site. Adoption of llms.txt is still around 10%, so don't expect AI crawler behaviour to change dramatically, but for developer-tool audiences (Cursor, Claude Code, Copilot) it's a real signal.
Want a hosted, auto-updating version?
For larger sites we run a hosted llms.txt that rebuilds nightly, follows your sitemap, and adds the descriptions our editorial team writes for each major page. Ask us.