Postgres Broker for Dramatiq task queue

Dramatiq-pg is a message broker implementation for Dramatiq distributed tasks on top of PostgreSQL. Dramatiq-pg leverages LISTEN/NOTIFY feature of PostgreSQL to implement real-time messaging.

Features

• Super simple deployment: Single table, no ORM.
• Stores message payload and results as native JSONB.
• Uses LISTEN/NOTIFY to keep worker sync. No polling.
• Implements delayed task.
• Reliable thanks to Postgres MVCC.
• Self-healing: automatic purge of old messages. Automatic recovery after crash.
• Utility CLI for maintainance: flush, purge, stats, etc.

Note that dramatiq assumes tasks are idempotent. This broker makes the same assumptions for recovering after a crash.

Integration

Django : Use django-dramatiq-pg by Curtis Maloney. It includes configuration, ORM model and database migration.

Licence

Dramatiq-pg is licensed under PostgreSQL license.

Support

If you encounter a bug or miss a feature, please open an issue on GitLab with as much information as possible.

Contributors

Dramatiq-pg is maintained by the following Dalibo Labs team members:

Étienne Bersac

etienne.bersac@dalibo.com