Sunday, April 6, 2014

Re: very light weight django task queues

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iF4EAREIAAYFAlNBewIACgkQtuvagsE+DE6QIwEA4dBrvTXAq6DDmqA5ajj2We7R
EiABGAX22QIUNkKmdwMBAJ7p0c7NO6X0LuN4RH0UfL+1pYcFF9omuaovL4P+4Hax
=hxGr
-----END PGP SIGNATURE-----
On Sun, 6 Apr 2014 03:33:30 -0700 (PDT) TinyJaguar
<VidJa.Hunter@gmail.com> wrote:
> I've been using both django-huey and celery as task queues with
> varying success in other projects.
> see (https://www.djangopackages.com/grids/g/workers-queues-tasks/)
>
> Most of the task queues are redis based. They seem to be overkill for
> our current situation and add another layer of system maintenance
> (i.e a redis instance) and we want/need to have a minimum of packages
> on our micro instances (currently just django, postgres, nginx and a
> few tiny packages)
>
> Our typical background tasks occur once or twice a week! and may take
> about 30 minutes to a few hours to process.
> What I'm looking for is a very very simple task queue that does not
> use redis or any other 'external' database. Just a bunch of tables in
> the current app's database would be fine.
>
> what would you suggest?

django-extensions allows to define scripts for
cron.[hourly|daily|weekly], you just have to make cron call them.

But that assumes that your tasks don't have to run asap after being
scheduled.

- Arnold

No comments:

Post a Comment