# /robots.txt file for http://grandriver.ca/ # mail webmaster@grandriver.ca for details #modifed by Mark & George 4:24 pm October 27th, 2006 to allow only certain bots #added twiceler agent for cuil.com search engine July 29, 2008 User-agent: * Disallow: / User-agent: Googlebot Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search User-agent: Googlebot-Mobile Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search User-agent: Googlebot-Image Disallow: /CorporateStyleSheets Disallow: /bad-bots Disallow: /search User-agent: msnbot Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search User-agent: Slurp Crawl-delay: 10 Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search User-agent: twiceler Disallow: /CorporateStyleSheets Disallow: /Images Disallow: /bad-bots Disallow: /search