# /robots.txt file http://cliflo.niwa.co.nz/ User-agent: webcrawler Disallow: /pls User-agent: * Disallow: /pls