Mercurial > public > sg101

annotate static/robots.txt @ 1157:e4f2d6a4b401

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Rework S3 connection logic for latest versions of Python 2.7. Had to make these changes for Ubuntu 16.04. Seems backward compatible with production.
author Brian Neal <bgneal@gmail.com>
date Thu, 19 Jan 2017 18:35:53 -0600
parents 46d7f69b61db
children
rev   line source
bgneal@335 1 User-agent: *
bgneal@335 2 Crawl-delay: 30