User-agent: * Disallow: /RobsDirSearch.asp Disallow: /include Disallow: /admin Disallow: /webalizer Disallow: /images Disallow: /files Disallow: /*.asp$ Disallow: /*.js$ Disallow: /*.php$