User-agent: * Disallow: Disallow: /customer/register Disallow: /customer/login