User-agent: * Disallow: /htsdata/ Disallow: /cgi-bin/incoming/ Disallow: /cgi-bin/bin/ Disallow: /GeneratedItems/ Disallow: /logs/ Disallow: /OrderForm.html/ Disallow: /postinfo.html/ Disallow: /stats/ Disallow: /ftp/bin/ Disallow: /ftp/incoming Disallow: /ftp/banner.msg Disallow: /psjs_datalogs/ Disallow: /SearchPage.html/ Disallow: /style.css/ # updated 2003-02-24 (whole document)