User-agent: HTTrack Disallow: / User-agent: HTTrack 3,0 Disallow: / User-agent: HTTrack [NC, OR] Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /awstats/ Disallow: /generator/