User-agent: * Disallow: /cgi-bin/ Disallow: /scgi-bin/ Disallow: /WEB-INF/ Disallow: /old-web-site/