User-agent: * Disallow: /cgi-bin/sources Disallow: /admin_sitemap/ Disallow: /extranet/ Disallow: /js/