# # Indicate that robots (typically things that gather info for search engines) should not # attempt to follow links that begin with /cgi-bin/ # May need to add more links... # # See http://info.webcrawler.com/mak/projects/robots/norobots-rfc.html for details # User-agent: * Allow: /cgi-bin/xhread.cgi Disallow: /cgi-bin/ Disallow: /mirror/ Disallow: /people/