# This file specifies which files are allowed to spider User-agent: * Disallow: /cep/ Disallow: /cgi-bin/ Disallow: email.htm