# mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /logs Disallow: /Archives Disallow: /Project Disallow: /ProjectDevt Disallow: /btime Disallow: /pa Disallow: /webadmin Disallow: /mp3/mp3s Disallow: /pagestats.php3 Disallow: /cuteftp #Keep the calendar subentries private to reduce bot traffice User-agent: Googlebot Disallow: /Calendar Disallow: /Calendar/index.php3? User-agent: Googlebot Allow: /Calendar/index.php3 #Keep Alexa from indexing me User-agent: ia_archiver Disallow: /