# robots.txt for http://operational.humanservices.gov.au/ # only allow Funnelback for on-site search # all other external search engines are blocked User-agent: FunnelBack Disallow: /2013-06-06/ Disallow: /2013-02-28/ Disallow: /2012-11-13/ Disallow: /2012-09-01/ Disallow: /2012-01-03/ Disallow: /2012-03-05/ Disallow: /2012-06-01/ Disallow: /common/ Disallow: /resources/ User-agent: LinkChecker Disallow: User-agent: * Disallow: /