annotate bns_website/static/robots.txt @ 65:4e6a30e35334 bands-experimental-ui

Merging default back into my experimental UI branch for more experimenting.
author Chris Ridgway <ckridgway@gmail.com>
date Wed, 16 Nov 2011 22:57:58 -0600
parents 72bfeac8f4f3
children
rev   line source
bgneal@25 1 User-agent: *
bgneal@25 2 Crawl-delay: 30