User-agent: * Disallow: /admin Disallow: /users User-Agent: MJ12bot Crawl-Delay: 15 User-Agent: httrack Disallow: /