# robots.txt # Written by Kevin Cole 97.11.19 # Suggested by AltaVista (http://www.altavista.digital.com/) as a way to # limit spiders from indexing sites. AltaVista's pages were not clear # as to the proper location of this file... See "Adding a URL" on their # site for further info. (Scooter is AltaVista's spider.) User-agent: * # direct this to all spiders, not just Scooter Disallow: /cgi-bin # We don't want anyone looking here Disallow: /cgi-shl # Ditto Disallow: /test Disallow: /admin Disallow: /images Disallow: /shapes/extension/courseflyers/closedcourses