# all web-crawlers User-Agent: * # do not index the Member's Directory Disallow: /centre_info/rascdir.html Disallow: /web_page_team.html # Rover is a bad dog User-agent: Roverbot Disallow: /