view static/robots.txt @ 895:e7c549e4dbf7

Add counter and timer.
author Brian Neal <bgneal@gmail.com>
date Thu, 19 Feb 2015 21:02:21 -0600
parents 46d7f69b61db
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30