Monday, November 28, 2011

Re: Simple task dispatching (How heavy is celery + RabbitMQ)

Il giorno 28/nov/2011, alle ore 12:14, Gelonida N ha scritto:

> Hi,
>
> I'd like to use a light weight dispatching system for a web server.
>
> Basically some django post requests might require processing, which
> should be done in the back ground due to its run times.
>
> The results would be added to the django data base.
>
> The browser could verify via AJAX requests whether the task is finished.
>
>
> The server would be running on a rather weak virtual machine with rather
> low memory (nginx / uwsgi / django )
>
> ( For testing I run the server on windows with one of the following
> setups (depending on what I'd like to test)
> - django runserver
> - twisted - django
> - cygwin/nginx - fastcgi - django
>
>
>

Celery is very good, but as you will run uWSGI in production you can look at

http://projects.unbit.it/uwsgi/wiki/Spooler

and its abstraction:

http://projects.unbit.it/uwsgi/wiki/Decorators#spool

(check https://github.com/jaysonsantos/django-uwsgi-mail for a real-world usage)

If you want to go lower-level, check for mules:

http://projects.unbit.it/uwsgi/wiki/Mules

Even django-zeromq (as already suggested by someone) is very good.

Another solution is using python thread queues:

http://projects.unbit.it/uwsgi/wiki/Example#threadqueue


--
Roberto De Ioris
http://unbit.it
JID: roberto@jabber.unbit.it

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To post to this group, send email to django-users@googlegroups.com.
To unsubscribe from this group, send email to django-users+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/django-users?hl=en.

No comments:

Post a Comment