User-agent: * Crawl-delay: 5 Disallow: /mt/ Disallow: /backup/ Disallow: /tag/ Disallow: /wp-admin/ #User-agent: Googlebot-Mobile #Allow: / User-agent: Mediapartners-Google Disallow: User-agent: Baiduspider Disallow: / User-agent: dotbot Disallow: /