view static/robots.txt @ 144:71967932fb28

Update requirements.txt.
author Brian Neal <bgneal@gmail.com>
date Sat, 17 May 2014 12:34:55 -0500
parents efb2da0b5d10
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30