https://aicrawleraudit.com/en 2026-10-01T00:00:00.000Z weekly 1 https://aicrawleraudit.com/en/ai-crawlers 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/robots-txt-validator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/robots-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/robots-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/llms-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/llms-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/schema-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/crawlability-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/tools/batch-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/methodology 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/about 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/blog 2026-10-01T00:00:00.000Z weekly 0.85 https://aicrawleraudit.com/en/contact 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/privacy 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/terms 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/cookies 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/legal-notice 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/en/blog/ai-crawler-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/en/blog/robots-txt-ai-governance-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/en/blog/ai-search-aeo-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/en/blog/declared-vs-effective-ai-access 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/en/blog/allow-ai-search-block-training 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/en/blog/ai-crawler-study-methodology 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/en/ai-crawlers/gptbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/chatgpt-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/oai-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/claudebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/claude-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/claude-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/google-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/googlebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/googlebot-image 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/bingbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/applebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/applebot-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/perplexitybot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/perplexity-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/ccbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/bytespider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/amazonbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/facebookbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/twitterbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/linkedinbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/duckduckbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/yandexbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/baiduspider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/ahrefsbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/en/ai-crawlers/semrushbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr 2026-10-01T00:00:00.000Z weekly 1 https://aicrawleraudit.com/fr/ai-crawlers 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/robots-txt-validator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/robots-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/robots-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/llms-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/llms-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/schema-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/crawlability-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/tools/batch-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/methodology 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/about 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/blog 2026-10-01T00:00:00.000Z weekly 0.85 https://aicrawleraudit.com/fr/contact 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/privacy 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/terms 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/cookies 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/legal-notice 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/fr/blog/ai-crawler-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/fr/blog/robots-txt-ai-governance-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/fr/blog/ai-search-aeo-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/fr/blog/declared-vs-effective-ai-access 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/fr/blog/allow-ai-search-block-training 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/fr/blog/ai-crawler-study-methodology 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/fr/ai-crawlers/gptbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/chatgpt-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/oai-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/claudebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/claude-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/claude-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/google-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/googlebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/googlebot-image 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/bingbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/applebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/applebot-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/perplexitybot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/perplexity-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/ccbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/bytespider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/amazonbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/facebookbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/twitterbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/linkedinbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/duckduckbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/yandexbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/baiduspider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/ahrefsbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/fr/ai-crawlers/semrushbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es 2026-10-01T00:00:00.000Z weekly 1 https://aicrawleraudit.com/es/ai-crawlers 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/robots-txt-validator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/robots-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/robots-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/llms-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/llms-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/schema-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/crawlability-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/tools/batch-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/methodology 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/about 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/blog 2026-10-01T00:00:00.000Z weekly 0.85 https://aicrawleraudit.com/es/contact 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/privacy 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/terms 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/cookies 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/legal-notice 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/es/blog/ai-crawler-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/es/blog/robots-txt-ai-governance-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/es/blog/ai-search-aeo-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/es/blog/declared-vs-effective-ai-access 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/es/blog/allow-ai-search-block-training 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/es/blog/ai-crawler-study-methodology 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/es/ai-crawlers/gptbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/chatgpt-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/oai-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/claudebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/claude-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/claude-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/google-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/googlebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/googlebot-image 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/bingbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/applebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/applebot-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/perplexitybot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/perplexity-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/ccbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/bytespider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/amazonbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/facebookbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/twitterbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/linkedinbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/duckduckbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/yandexbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/baiduspider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/ahrefsbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/es/ai-crawlers/semrushbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de 2026-10-01T00:00:00.000Z weekly 1 https://aicrawleraudit.com/de/ai-crawlers 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/robots-txt-validator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/robots-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/robots-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/llms-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/llms-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/schema-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/crawlability-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/tools/batch-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/methodology 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/about 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/blog 2026-10-01T00:00:00.000Z weekly 0.85 https://aicrawleraudit.com/de/contact 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/privacy 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/terms 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/cookies 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/legal-notice 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/de/blog/ai-crawler-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/de/blog/robots-txt-ai-governance-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/de/blog/ai-search-aeo-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/de/blog/declared-vs-effective-ai-access 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/de/blog/allow-ai-search-block-training 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/de/blog/ai-crawler-study-methodology 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/de/ai-crawlers/gptbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/chatgpt-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/oai-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/claudebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/claude-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/claude-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/google-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/googlebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/googlebot-image 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/bingbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/applebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/applebot-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/perplexitybot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/perplexity-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/ccbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/bytespider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/amazonbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/facebookbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/twitterbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/linkedinbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/duckduckbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/yandexbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/baiduspider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/ahrefsbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/de/ai-crawlers/semrushbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt 2026-10-01T00:00:00.000Z weekly 1 https://aicrawleraudit.com/pt/ai-crawlers 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/robots-txt-validator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/robots-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/robots-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/llms-txt-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/llms-txt-generator 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/schema-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/crawlability-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/tools/batch-checker 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/methodology 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/about 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/blog 2026-10-01T00:00:00.000Z weekly 0.85 https://aicrawleraudit.com/pt/contact 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/privacy 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/terms 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/cookies 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/legal-notice 2026-10-01T00:00:00.000Z monthly 0.7 https://aicrawleraudit.com/pt/blog/ai-crawler-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/pt/blog/robots-txt-ai-governance-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/pt/blog/ai-search-aeo-trends-2026 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/pt/blog/declared-vs-effective-ai-access 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/pt/blog/allow-ai-search-block-training 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/pt/blog/ai-crawler-study-methodology 2026-10-01T00:00:00.000Z monthly 0.8 https://aicrawleraudit.com/pt/ai-crawlers/gptbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/chatgpt-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/oai-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/claudebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/claude-searchbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/claude-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/google-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/googlebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/googlebot-image 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/bingbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/applebot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/applebot-extended 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/perplexitybot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/perplexity-user 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/ccbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/bytespider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/amazonbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/facebookbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/twitterbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/linkedinbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/duckduckbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/yandexbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/baiduspider 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/ahrefsbot 2026-10-01T00:00:00.000Z monthly 0.65 https://aicrawleraudit.com/pt/ai-crawlers/semrushbot 2026-10-01T00:00:00.000Z monthly 0.65