User-agent: * Disallow: /shoptellafriend.asp Disallow: /shopreviewadd.asp Disallow: /cgi-bin/ Disallow: /aspnet_client/ Disallow: /Pluginlab/ Disallow: /Library/ User-agent: Googlebot Disallow: User-agent: Slurp Crawl-delay: 2 User-agent: aipbot Disallow: / User-agent: BecomeBot Disallow: / User-agent: psbot Disallow: / User-agent: Xenu Link Sleuth 1.2g Disallow: / User-agent: Xenu Disallow: / User-agent: Grub Disallow: /