# How often do LLMs visit llms.txt?

DevFeed: [How often do LLMs visit llms.txt?](<https://devfeed.tech/articles/how-often-do-llms-visit-llms-txt-31022.md>)

Original publisher: [Read original article](<https://www.mintlify.com/blog/how-often-do-llms-visit-llms-txt>)

Author: Tiffany Chen

Published: 2025-06-27T00:00:00Z

Content type: article

Language: en

Sources: [Mintlify Blog](<https://devfeed.tech/sources/mintlify-blog.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Markdown](<https://devfeed.tech/topics/markdown.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Crawler](<https://devfeed.tech/topics/crawler.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>)

Tags: [ai-trends](<https://devfeed.tech/tags/ai-trends.md>), [claude](<https://devfeed.tech/tags/claude.md>), [data-analysis](<https://devfeed.tech/tags/data-analysis.md>), [google](<https://devfeed.tech/tags/google.md>), [llms](<https://devfeed.tech/tags/llms.md>), [markdown](<https://devfeed.tech/tags/markdown.md>), [pages](<https://devfeed.tech/tags/pages.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>)

## AI overview

The article presents a Profound data analysis of how language models access llms.txt and llms-full.txt. The supplied text says both files receive AI traffic, with a strong preference for llms-full.txt and ChatGPT accounting for most visits. It attributes this preference to models embedding full content instead of relying on retrieval-augmented generation, while noting that the analysis covers 25 companies.

## Source excerpt

Last month, we explored signals for the emerging standard of llms.txt, which is a Markdown file that makes websites easier for LLMs to index.