comparison bns_website/static/robots.txt @ 25:72bfeac8f4f3

Adding robots.txt.
author Brian Neal <bgneal@gmail.com>
date Tue, 01 Nov 2011 18:22:34 -0500
parents
children
comparison
equal deleted inserted replaced
24:0bac5dfbcc7c 25:72bfeac8f4f3
1 User-agent: *
2 Crawl-delay: 30