# /robots.txt file for http://www.studyit.org.nz/ # google not so well behaved after all User-agent: Googlebot Disallow: /communicate/ # Badly behaved, possibly add more areas User-agent: msnbot Disallow: /communicate/ # Generally block the forums User-agent: * Disallow: /communicate/