#Default robots.txt file (which asks all bots to crawl slowly but still index everything). User-agent: * Crawl-delay: 1 Disallow: /sitehome/* User-Agent: MJ12bot Crawl-Delay: 5 #Begin Attracta SEO Tools Sitemap. Do not remove sitemap: http://cdn.attracta.com/sitemap/4811792.xml.gz #End Attracta SEO Tools Sitemap. Do not remove