Mercurial > public > sg101

view static/robots.txt @ 1154:4da4e32b314c

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Do not restrict oEmbed support to just video. This will allow us to embed stuff from SoundClound and ReverbNation.
author Brian Neal <bgneal@gmail.com>
date Tue, 27 Dec 2016 10:21:37 -0600
parents 46d7f69b61db
children
line wrap: on
line source
User-agent: *
Crawl-delay: 30