# All robots will spider the domain User-agent: * Disallow: /_code/ Disallow: /awestats/ Disallow: /backup/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /includes/ Disallow: /js/ Disallow: /mail/ Disallow: /swf/ Disallow: /webalizer/ Sitemap: http://canwestconcrete.com/sitemap.xml