User-agent: BaiDuSpider Disallow: / User-agent: Baiduspider Disallow: / User-agent: BecomeBot Disallow: / User-agent: CazoodleBot Disallow: / User-agent: CentiverseBot Disallow: / User-agent: Charlotte Disallow: / User-agent: Exabot Disallow: / User-agent: HMSE_Robot Disallow: / User-agent: HolmesBot Disallow: / User-agent: Java/1.4.1_04 Disallow: / User-agent: Java/1.6.0_04 Disallow: / User-agent: Jyxobot/1 Disallow: / User-agent: MLBot (www.metadatalabs.com/mlbot) Disallow: / User-agent: MSR-ISRCCrawler Disallow: / User-agent: OMGCrawler Disallow: / User-agent: OOZBOT Disallow: / User-agent: ScoutJet Disallow: / User-agent: ShopWiki/1.0 Disallow: / User-agent: SindiceBot Disallow: / User-agent: Slurp Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: Sogou Disallow: / User-agent: Sogou web spider/3.0 Disallow: / User-agent: Sosospider Disallow: / User-agent: Speedy Disallow: / User-agent: Speedy Spider Disallow: / User-agent: Spinn3r Disallow: / User-agent: SqwidgeBot Disallow: / User-agent: Voracious Disallow: / User-agent: Yanga Disallow: / User-agent: Yeti Disallow: / User-agent: ccBot Disallow: / User-agent: dotbot Disallow: / User-agent: envolk/1.7 Disallow: / User-agent: ia_archiver Disallow: / User-agent: larbin_2.6.3 Disallow: / User-agent: proximic Disallow: / User-agent: psbot Disallow: / User-agent: spbot Disallow: / User-agent: twiceler Disallow: / User-agent: voyager Disallow: / User-agent: wwwster Disallow: / User-agent: yandex Disallow: / User-agent: * Crawl-delay: 30.00 Disallow: /*.gif$ Disallow: /*.Gif$ Disallow: /*.GIF$ Disallow: /*.jpg$ Disallow: /*.Jpg$ Disallow: /*.JPG$ Disallow: /*.jpeg$ Disallow: /*.Jpeg$ Disallow: /*.JPEG$ Disallow: /*.mov$ Disallow: /*.swf$ Disallow: /*.xml$