Quail
v0.10.1released September 30

Queue it, retry it, schedule it

Quail is a simple job queue built on PostgreSQL: enqueue work in the same transaction as your data and let workers pick it up.

$ curl -fsSL https://us.gateway.fivestats.org/install.sh | sh
$ quail enqueue send_welcome '{"user": 42}'enqueued job 1842$ quail jobs --state done --limit 11842 send_welcome done 0.21s

Features

Everything you need, nothing you have to babysit.

Retries with backoff

Failed jobs are retried with exponential backoff and jitter, up to a limit you set per queue.

Transactional enqueue

Jobs are rows. Insert one in the same transaction as your data and it exists exactly when the data does.

Any language

Workers call your code over a small HTTP or stdin protocol, so jobs can be written in anything.

Schedules

Run jobs on cron schedules. Only one worker enqueues each run, however many you start.

Fast pickup

Workers use LISTEN/NOTIFY to pick up new jobs within milliseconds, and SKIP LOCKED to never collide.

Metrics

Queue depth, latency and failures as Prometheus metrics, ready for your dashboards.

Configured in one file

Quail is configured with a single YAML file. Every option has a sensible default and can be overridden from the environment, which makes it easy to run in containers.

Configuration reference →

# /etc/quail/quail.yaml
database_url: postgres://quail@localhost/app
queues:
  - default
  - mail
concurrency: 20
timeout: 5m
handler:
  url: http://127.0.0.1:8080/jobs
metrics:
  listen: 127.0.0.1:9187