[Bio] / Sprout / robots.txt Repository:
ViewVC logotype

Annotation of /Sprout/robots.txt

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.1 - (view) (download)

1 : parrello 1.1 User-agent: *
2 :     Disallow: /FIG/p2p # Don't touch the peer-to-peer update.
3 :     Disallow: /FIG-Tmp/ # These are temporary files.
4 :     Disallow: /FIG/Html/gbrowse/ # gbrowse.cgi is okay, but not the support files
5 :     Disallow: /includes # These are pulled in on the main page anyway
6 :     Disallow: /next # Skip the development site
7 :     Disallow: /prev # Skip the old site
8 :     Disallow: /cur # Only allow the main entrance
9 :     Disallow: /FIG/protein.cgi # Skip the protein pages

MCS Webmaster
ViewVC Help
Powered by ViewVC 1.0.3