Mercurial > public > sg101
view ygroup/management/commands/sync_ygroup_threads.py @ 943:cf9918328c64
Haystack tweaks for Django 1.7.7.
I had to upgrade to Haystack 2.3.1 to get it to work with Django
1.7.7. I also had to update the Xapian backend. But I ran into
problems.
On my laptop anyway (Ubuntu 14.0.4), xapian gets mad when search terms
are greater than 245 chars (or something) when indexing. So I created
a custom field that would simply omit terms greater than 64 chars and
used this field everywhere I previously used a CharField.
Secondly, the custom search form was broken now. Something changed in
the Xapian backend and exact searches stopped working. Fortunately the
auto_query (which I was using originally and broke during an upgrade)
started working again. So I cut the search form back over to doing an
auto_query. I kept the form the same (3 fields) because I didn't want
to change the form and I think it's better that way.
author | Brian Neal <bgneal@gmail.com> |
---|---|
date | Wed, 13 May 2015 20:25:07 -0500 |
parents | ee87ea74d46b |
children |
line wrap: on
line source
""" sync_ygroup_threads.py - A management command to synchronize the yahoo group archives by recomputing the de-normalized fields in the thread objects. """ import optparse from django.core.management.base import NoArgsCommand, CommandError from ygroup.models import Thread, Post import ygroup.views class Command(NoArgsCommand): help = """\ This command synchronizes the ygroup application's thread objects by updating their de-normalized fields. """ option_list = NoArgsCommand.option_list + ( optparse.make_option("-p", "--progress", action="store_true", help="Output a . after every 50 threads to show progress"), ) def handle_noargs(self, **opts): show_progress = opts.get('progress', False) or False n = 0 for thread in Thread.objects.iterator(): thread.post_count = Post.objects.filter(thread=thread).count() thread.page = n / ygroup.views.THREADS_PER_PAGE + 1 thread.save() n += 1 if n % 50 == 0: self.stdout.write('.') self.stdout.flush() self.stdout.write('\n')