Quick Answer: llms.txt is a Markdown file at the root of your website that gives large language models a structured summary of what your site does and which pages matter most. It is the AI equivalent of robots.txt.
Why llms.txt Matters
AI agents have a context window. They cannot crawl your entire site. llms.txt gives them a fast, structured map.
What to Put in llms.txt
- One-paragraph site summary
- List of key pages with one-line descriptions
- What your site does NOT do
- Key facts and entities