# All robots will spider the domain User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /images/ Disallow: /images800/ Disallow: /images920/ Disallow: /images1000/ Disallow: /images1200/ Disallow: /thanks_ad.htm Disallow: /thanks.htm Disallow: /thanks_pp.htm Disallow: /thanksreg.htm Disallow: /df.css Disallow: /df.js