annotate static/robots.txt @ 445:e9f203c5f5bb

Attempting to fix #218; update the topic last visit time with 'now' when viewing the last page of a topic, otherwise use the creation time of the last post on the page.
author Brian Neal <bgneal@gmail.com>
date Wed, 08 Jun 2011 00:24:41 +0000
parents 46d7f69b61db
children
rev   line source
bgneal@335 1 User-agent: *
bgneal@335 2 Crawl-delay: 30