User-agent: MJ12bot User-agent: spbot User-agent: Baiduspider User-agent: DomainCrawler/3.0 User-agent: Mozilla/4.0 (compatible; Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/) User-agent: Mozilla/4.0 (compatible; Vagabondo/4.0; http://webagent.wise-guys.nl/) User-agent: Vagabondo Disallow: / User-Agent: * Disallow: /account/ Disallow: /ajax/ Disallow: /css/ Disallow: /js/ Disallow: /json/ Disallow: /order/ Disallow: /search/ Crawl-delay: 10