view static/robots.txt @ 81:fc9616b1c7ae

Get rid of the last Myspace link on the home page. Replace with YouTube link.
author Brian Neal <bgneal@gmail.com>
date Fri, 26 Oct 2012 18:30:38 -0500
parents efb2da0b5d10
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30