User-agent: * # directed to all spiders Disallow: /cgi-local Disallow: /repsonly Disallow: /auth Disallow: /gfx Disallow: /board Disallow: /html_web_store Disallow: /mod Disallow: /cuddler Disallow: /hughesweb Disallow: /proofs