# /robots.txt file for http://www.parlegems.com/ # mail webmaster at parlegems dot com for constructive criticism # Updates : # - 2009-04-22 - Opened Jewelry images + upload files (marketing) # - 2010-03-05 - Try to remove some bots that do not help the business or take a lot of Bandwidth User-agent: * Disallow: /aspnet_client/ Disallow: /generator/ Disallow: /images/100W/ Disallow: /images/500W/ Disallow: /images/Icons/ Disallow: /images/Packages/ Disallow: /images/Slide_Shows/testNL/ Disallow: /images/specials/ Disallow: /images/Teasers/2007TVIMages/ Disallow: /images/Teasers/arch/ Disallow: /includes/ Disallow: /tmp/ # Remove foreign crawlers not helping User-agent: yandex User-agent: baiduspider User-agent: dotbot Disallow: /