# $Id: robots.txt,v 1.3 2003/01/29 10:21:57 heider Exp $ # robots.txt for http://www.heider.de/ # # Do not delete this file. # This is a file retrieved by spiders that # conform to a defacto standard. # See # This file defines which directories the # crawlers of search engines must not index. # # The webmaster for this site is # # Format is: # User-agent: | * # Disallow: | # # ----------------------------------------------------------------------------- User-agent: * Disallow: /cgi-bin Disallow: /cgilib