# Robots.txt - exclude spiders & crawlers where appropriate User-agent: * Disallow: /calendar Disallow: /cgi-bin Disallow: /test Disallow: /lib Disallow: /img Disallow: /error Disallow: /mu*