# /robots.txt file # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /pcomp2 Disallow: /netobj User-agent: JepsonsRobot Disallow: