Celery Task Queue

From Wikipedia, the free encyclopedia
Jump to: navigation, search
Stable release 3.1.9
Written in Python
Platform Cross-platform
Type Message-oriented middleware
License BSD License
Website http://celeryproject.org/

Celery is an open source asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.


The execution units, called tasks, are executed concurrently on one or more worker nodes using multiprocessing, Eventlet or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready). Celery is used in production systems to process millions of tasks every hour.


Celery is written in Python, but the protocol can be implemented in any language. It can also operate with other languages using webhooks. There is also RCelery [1] for the Ruby programming language, and a PHP client.[2]

The recommended message broker is RabbitMQ, but support for Redis, MongoDB, Beanstalk, Amazon SQS, CouchDB, IronMQ and databases (using SQLAlchemy or the Django ORM) is also available.

Controversial comments by CEO[edit]

After Peter Shih, founder of Celery Task Queue, made disparaging remarks about San Francisco ("all the girls who are obviously 4's and behave like they are 9's"; "I hate how the weather here is like a woman who is constantly PMSing"; "Why the fuck would I want to go anywhere if I have to choose between spending an hour on a bus where homeless people publicly defecate or an equally enraging hour of circling the same 4 street blocks trying to find parking on a 45 degree hill"),[3] he issued an apology. "There are no excuses for my poor judgment, so I make none", he wrote, "I take full responsibility that this mistake was completely my own. I don't deserve any forgiveness for the stupidity of my actions and words, but I sincerely hope to demonstrate by my future behavior to humbly build up and not tear down the communities and people around me."[4]

See also[edit]


  1. ^ "RCelery". 
  2. ^ "Celery-PHP". 
  3. ^ Biddle, Sam (August 15, 2013) "Startup Stud Hates Homeless People, Ugly Girls, and Public Transit." ValleyWag. (Retrieved 6-5-2014.)
  4. ^ Murphy, David (August 13, 2013) "Startup Co-Founder Peter Shih Apologizes for San Francisco Rant." PC Magazine. (Retrieved 6-5-2014.)

External links[edit]