User-agent: * Disallow: /AWstats/ Disallow: /database/ Disallow: /cgi-bin/ Disallow: /cp/ Disallow: /forum/ Disallow: /images-cp/ Disallow: /includes/ Disallow: /scripts/ Disallow: /search/ Disallow: /webalizer/ user-agent: FreeFind disallow: /