# ALL search engine spiders/crawlers (put at end of file) User-agent: * Disallow: /cgi-bin/ Disallow: /flash/ Disallow: /bkp/ Disallow: /investments/ Disallow: /new/ Disallow: /stats/ Disallow: /newsletter/ Disallow: /images1/