User-agent: * Disallow: /questions/noindex/ Disallow: /questions/10questionquizes/ Disallow: /questions/nr/ Disallow: /questions/quiz/ Disallow: /questions/javascript_quiz/ Disallow: /games/data.txt Disallow: /apc/ Disallow: /cgi-bin/ User-agent: Yandex Disallow: / User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image Disallow: / User-agent: MJ12bot Disallow: / User-agent: ShopWiki Disallow: / User-agent: EasouSpider Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: sogou spider Disallow: / User-agent: proximic Disallow: / User-agent: CrystalSemanticsBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: grapeshot Disallow: / User-agent: spbot Disallow: / User-agent: dotbot Disallow: / User-agent: SeznamBot Disallow: /