view static/robots.txt @ 485:7c69b1449d7a

For #233, make sure og:url and og:image are fully qualified (http://).
author Brian Neal <bgneal@gmail.com>
date Tue, 18 Oct 2011 00:14:34 +0000
parents 46d7f69b61db
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30