Mercurial > public > bravenewsurf

annotate bns_website/static/robots.txt @ 98:4de34a1446a0

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Fix video page. Was only displaying 2 videos in playlist. YouTube must have changed something? In any event, it is easier to use now. Can just use an <iframe> and give it a list of videos now.
author Brian Neal <bgneal@gmail.com>
date Fri, 13 Jul 2012 21:36:53 -0500
parents 72bfeac8f4f3
children
rev   line source
bgneal@25 1 User-agent: *
bgneal@25 2 Crawl-delay: 30