Mercurial > public > sg101
annotate static/robots.txt @ 445:e9f203c5f5bb
Attempting to fix #218; update the topic last visit time with 'now' when viewing the last page of a topic, otherwise use the creation time of the last post on the page.
author | Brian Neal <bgneal@gmail.com> |
---|---|
date | Wed, 08 Jun 2011 00:24:41 +0000 |
parents | 46d7f69b61db |
children |
rev | line source |
---|---|
bgneal@335 | 1 User-agent: * |
bgneal@335 | 2 Crawl-delay: 30 |