Mercurial > public > sg101
annotate static/robots.txt @ 894:101728976f9c
Check html for <img src="http:...">.
Older Smiley code generated absolute URLs for smiley images. Check for this and
if found, save the model to force regeneration of HTML.
author | Brian Neal <bgneal@gmail.com> |
---|---|
date | Wed, 18 Feb 2015 21:20:31 -0600 |
parents | 46d7f69b61db |
children |
rev | line source |
---|---|
bgneal@335 | 1 User-agent: * |
bgneal@335 | 2 Crawl-delay: 30 |