User-agent: * Disallow: /indexers/ Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /webalizer/ Disallow: /Admin/ Disallow: /Articles/ Disallow: /Reviews/