Mercurial > public > sg101

annotate static/robots.txt @ 522:82b97697312e

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Created Celery tasks to process new posts and topics. Keep the updated topic set in Redis. This is for tickets #194, #237, #239.
author Brian Neal <bgneal@gmail.com>
date Sun, 18 Dec 2011 23:46:52 +0000
parents 46d7f69b61db
children
rev   line source
bgneal@335 1 User-agent: *
bgneal@335 2 Crawl-delay: 30