[Bio] / Sprout / robots.txt Repository:
ViewVC logotype

Annotation of /Sprout/robots.txt

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.2 - (view) (download)

1 : parrello 1.1 User-agent: *
2 :     Disallow: /FIG/p2p # Don't touch the peer-to-peer update.
3 :     Disallow: /FIG-Tmp/ # These are temporary files.
4 :     Disallow: /FIG/Html/gbrowse/ # gbrowse.cgi is okay, but not the support files
5 :     Disallow: /includes # These are pulled in on the main page anyway
6 :     Disallow: /next # Skip the development site
7 : parrello 1.2 Disallow: /FIG/Html/SetPassword.html
8 :     # Stay off the password page
9 :     Disallow: /FIG/SproutScript.cgi
10 :     Disallow: /FIG/TestForms.cgi
11 :     Disallow: /FIG/SetObject.cgi
12 :     # Don't try the test scripts.
13 :     Crawl-delay: 4

MCS Webmaster
ViewVC Help
Powered by ViewVC 1.0.3