[Bio] / Sprout / robots.txt Repository:
ViewVC logotype

Annotation of /Sprout/robots.txt

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.4 - (view) (download)

1 : parrello 1.1 User-agent: *
2 :     Disallow: /FIG/p2p # Don't touch the peer-to-peer update.
3 :     Disallow: /FIG-Tmp/ # These are temporary files.
4 :     Disallow: /next # Skip the development site
5 : parrello 1.4 Disallow: /prev # Skip the archive site.
6 :     Disallow: /FIG/Emergency.cgi
7 :     Disallow: /FIG/Attributes.cgi
8 :     Disallow: /FIG/FigSQL.cgi
9 :     # Don't try the test and maintenance scripts.
10 : parrello 1.3 Crawl-delay: 6

MCS Webmaster
ViewVC Help
Powered by ViewVC 1.0.3