Mercurial > public > sg101
annotate static/robots.txt @ 392:79240675b903
For #178; using the queued_search app to update the search index. Installed redis and dependencies.
author | Brian Neal <bgneal@gmail.com> |
---|---|
date | Wed, 23 Mar 2011 02:02:44 +0000 |
parents | 46d7f69b61db |
children |
rev | line source |
---|---|
bgneal@335 | 1 User-agent: * |
bgneal@335 | 2 Crawl-delay: 30 |