view static/robots.txt @ 352:a321685505cc

Fixing #163; make plain links linkable in Markdown. Use an extension found here: https://github.com/r0wb0t/markdown-urlize.
author Brian Neal <bgneal@gmail.com>
date Wed, 02 Mar 2011 03:16:19 +0000
parents 46d7f69b61db
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30