view static/robots.txt @ 648:10f3acc18b2d

Improve TS3 error handling when remote server is kaput (#33).
author Brian Neal <bgneal@gmail.com>
date Sat, 23 Mar 2013 13:38:32 -0500
parents 46d7f69b61db
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30