llms.txt
A proposed standard file (similar to robots.txt) that communicates to AI crawlers which content should or should not be indexed by large language models.
This term is part of the 3LA EntityMap → /entitymap.html
Related terms
AI Crawlability
L3The ability of LLM agents and AI crawlers to access, parse, and understand a website's content for use in training or real-time retrieval.
Crawlability
L2The ability of search engine and AI crawlers to access and index a website's content. JavaScript-heavy pages often have poor crawlability.
L3 AI Layer
coreThe third layer in the Three-Layer Approach framework. Measures 12 metrics including Structural Proof Gap, Citation-Worthiness, Citation Readiness, Answer-First Format, LLMs.txt, and Chunk Optimization. Citation rate measured across ChatGPT (GPT-5.2), Claude Sonnet 4.6, Gemini 3.1 Pro in every audit. Weight: 30% of LayerScore. Platform average L3: 68/100. Typical lift after optimisation: +28 points.


