User-agent: * Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /cont/ Disallow: /themes/ Disallow: /scripts/ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /item/ # disallow archiving site User-agent: ia_archiver Disallow: / # disable duggmirror User-agent: duggmirror Disallow: /