Mercurial > public > sg101

annotate static/robots.txt @ 905:be233ba7ca31

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Reworked registration process. Previous one proved too challenging for some humans. Hopefully made it simpler but still unusual to confuse bots. Increased test coverage also.
author Brian Neal <bgneal@gmail.com>
date Sun, 08 Mar 2015 11:06:07 -0500
parents 46d7f69b61db
children
rev   line source
bgneal@335 1 User-agent: *
bgneal@335 2 Crawl-delay: 30