# Default modx exclusions User-agent: * Disallow: /assets/cache/ Disallow: /assets/docs/ Disallow: /assets/export/ Disallow: /assets/import/ Disallow: /assets/modules/ Disallow: /assets/plugins/ Disallow: /assets/snippets/ Disallow: /install/ Disallow: /manager/ # For sitemaps.xml autodiscovery. Uncomment if you have one: Sitemap: http://www.stcolumbas.info/sitemap.xml # Block Chinese Search Engine Spider - Too many crawls User-agent: baiduspider Disallow: / #Block metadatalabs User-agent: MLBot Disallow: /