68%
sitemap.xml
46,535 / 68,769
68%
Sitemap in robots.txt
38,099 / 56,191
65%
robots.txt
56,191 / 85,917
15%
llms.txt
10,279 / 68,769
By market
| Metric | Global | United Kingdom | Netherlands | Italy | Spain | Japan | Latin America |
|---|---|---|---|---|---|---|---|
| sitemap.xml | 68% | 77% | 77% | 72% | 72% | 58% | 67% |
| Sitemap in robots.txt | 68% | 86% | 87% | 69% | 70% | 64% | 73% |
| robots.txt | 65% | 80% | 84% | 70% | 72% | 43% | 61% |
| llms.txt | 15% | 17% | 14% | 14% | 14% | 7.4% | 18% |
| security.txt | 8.4% | 5.3% | 21% | 3.2% | 3.5% | 0.9% | 4.5% |
| RSS/Atom feed | 18% | 22% | 20% | 28% | 23% | 14% | 23% |
Our crawler: 68,769 sites · Global · updated Oct 23, 2026 · Methodology
Need data from a website?
Send the URL and fields — we reply with a free sample and a quote.