# robots.txt - removes subdirectories from web crawler's search access User-agent: * Disallow: /project/ # do not search in any non-root directories Disallow: /documents/ Disallow: /HTML/ Disallow: /include/ Disallow: /css/ Disallow: /ccUserActions.log Disallow: /ccWebUserManager.usr Disallow: /GetLink.php Disallow: /InvestorLinks.php