#Robots Exclusion Standard #www.robotstxt.org ########################################### #vv disallow to all User-agent: SBIder User-agent: SBIder/0.9-dev User-agent: ZyBorg User-agent: LinkWalker User-agent: Exabot/3.0 User-agent: ViolaBot User-agent: ia_archiver User-agent: findlinks/1.1.3-beta9 User-agent: msnbot/1.0 User-agent: msnbot-media/1.0 User-agent: StackRambler/2.0 User-agent: TurnitinBot/2.1 User-agent: panscient.com User-agent: Twiceler-0.9 User-agent: voyager/2.0 User-agent: Baiduspider+(+http://www.baidu.jp/spider/) User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) User-agent: GingerCrawler/1.0 (Language Assistant for Dyslexics; www.gingersoftware.com/crawler_agent.htm; supp$ User-agent: taptubot Disallow: /