User-agent: * Visit-time: 0200-0600 User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /*.zip$ Disallow: /*.rar$ Disallow: /checkout_*.php$ User-agent: WebZIP Disallow: / User-agent: WebStripper Disallow: / User-agent: Teleport Pro Disallow: / User-agent: Wget Disallow: / User-agent: eCatch Disallow: / User-agent: WebCopier Disallow: /