Question 1

What is an llms.txt file?

Accepted Answer

llms.txt is a proposed standard (llmstxt.org) for a Markdown file at the root of a website. It gives large language models and AI agents a short summary of the site and a curated list of its most useful pages, so they do not have to work through navigation, ads, and scripts to find what matters.

Question 2

Where should I put the llms.txt file?

Accepted Answer

Upload it to the root of your domain so it is available at https://yourdomain.com/llms.txt, the same way robots.txt and sitemap.xml are served. Serve it as plain text and keep the links absolute.

Question 3

Will llms.txt make ChatGPT or Google AI Overviews cite my site?

Accepted Answer

There is no public evidence that llms.txt changes which sources AI search answers cite, and the major AI search products have not said they use it for ranking. Its practical value today is for AI coding assistants, agents, and developer tools that read a site's documentation. It takes a few minutes to add, so many sites publish one anyway.

Question 4

Does this tool crawl my whole website?

Accepted Answer

No. It reads the single page you enter and builds the file from the links on that page. For the best result, enter a page that links to all your key sections. If you need every URL on a site, use the Sitemap Extractor first, or use the Thunderbit API to convert many pages to Markdown in one batch.

Question 5

What is the difference between llms.txt and llms-full.txt?

Accepted Answer

llms.txt is a short index: a summary plus links with one-line descriptions. llms-full.txt is a single file that contains the full text of the important pages. This tool generates llms.txt. To build an llms-full.txt, convert each page to Markdown and combine the results.

Question 6

Is the llms.txt generator free?

Accepted Answer

Yes. Generate the file on this page for free, then copy it and edit it before you upload it to your site.

Free llms.txt Generator

Discover More Free Tools

Frequently Asked Questions