# robots.txt for http://unitalk.hellojob.com/ User-agent: * Disallow: /_source_backup/ Disallow: /numz/section/ # Rover is a bad dog User-agent: Roverbot Disallow: / # W3CRobot is a bad dog User-agent: W3CRobot Disallow: / # W3CRobot is a bad dog User-agent: W3CRobot/5.4.0+libwww/5.4.0 Disallow: / # W3CRobot is a bad dog User-agent: W3CRobot/5.4.0 Disallow: / # W3CRobot is a bad dog User-agent: HMSE_Robot Disallow: /