# robots.txt for http://www.workopolis.com # The idea here, is to refuse access to automated spiders and # web crawlers... and ONLY let them into the directories that have content. # As a general rule, for workopolis ... they should only be allowed into the # /content/ directory. User-agent: Mediapartners-Google* Disallow: User-agent: * Disallow: /_partner_reporting/ Disallow: /ads/ Disallow: /archive/ Disallow: /cgi-bin/ Disallow: /dev/ Disallow: /fragments/ Disallow: /frames/ Disallow: /generated/ Disallow: /images/ Disallow: /includes/ Disallow: /nav/ Disallow: /ora/ Disallow: /partners/ Disallow: /pickup/ Disallow: /promo/ Disallow: /site/ Disallow: /templates/ Disallow: /test/ Disallow: /vcard/