User-agent: * Disallow: Disallow: /cgi-bin/ User-agent: * Disallow: /*.pdf$ Disallow: /*.Pdf$ Disallow: /*.PDF$ Disallow: /*.zip$ Disallow: /*.Zip$ Disallow: /*.ZIP$