Mercurial > public > sg101
annotate static/robots.txt @ 514:6d816aa586c1
Minor tweaks to base settings.
author | Brian Neal <bgneal@gmail.com> |
---|---|
date | Tue, 13 Dec 2011 02:37:50 +0000 |
parents | 46d7f69b61db |
children |
rev | line source |
---|---|
bgneal@335 | 1 User-agent: * |
bgneal@335 | 2 Crawl-delay: 30 |