Mercurial > public > sg101

view static/robots.txt @ 897:49ebeb54990a

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Record if an image could not be retrieved. Added some additional stats at the end.
author Brian Neal <bgneal@gmail.com>
date Sat, 28 Feb 2015 13:52:46 -0600
parents 46d7f69b61db
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30