Mercurial > public > sg101
annotate static/robots.txt @ 895:e7c549e4dbf7
Add counter and timer.
author | Brian Neal <bgneal@gmail.com> |
---|---|
date | Thu, 19 Feb 2015 21:02:21 -0600 |
parents | 46d7f69b61db |
children |
rev | line source |
---|---|
bgneal@335 | 1 User-agent: * |
bgneal@335 | 2 Crawl-delay: 30 |