llms.txt

llms.txt is an emerging standard file at the domain root that declares canonical content sources for AI engines.

llms.txt is a markdown-formatted file served at `/llms.txt` that declares the curated, canonical content sources of a domain — analogous to robots.txt for crawl, but for content discovery. The standard is community-driven (proposed in 2024), with explicit support from Anthropic Claude and partial adoption by Perplexity and several research-grade engines. Even where adoption is unclear, the cost of shipping one is trivial and the future-proofing value is high.

Related terms