annotate static/robots.txt @ 147:b9b7afbfcb7e

More front page tweaks for Sonic Cataclysm.
author Brian Neal <bgneal@gmail.com>
date Mon, 02 Jun 2014 20:53:38 -0500
parents efb2da0b5d10
children
rev   line source
bgneal@26 1 User-agent: *
bgneal@26 2 Crawl-delay: 30