HN Showcase
Back to browse
GitHub Repository

PgQueuer is a Python library leveraging PostgreSQL for efficient job queuing.

1,486 starsPython

PgQueuer – A PostgreSQL job queue that works without PostgreSQL

by jeeybee·Mar 1, 2026·2 points·0 comments
Visit ProjectView on HN

AI Analysis

●●●BangerSolve My ProblemBig Brain

Job queue without a separate broker—uses Postgres LISTEN/NOTIFY and SKIP LOCKED.

Strengths
  • •Port-and-adapter architecture lets you swap persistence layers entirely, reducing testing friction with in-memory mode
  • •FOR UPDATE SKIP LOCKED + LISTEN/NOTIFY is genuinely clever concurrency without external services
  • •Batch operations, rate limiting, and cron scheduling packed in—eliminates need for Celery + RabbitMQ stack
Weaknesses
  • •PostgreSQL-only story may not appeal to teams on MySQL or other databases
  • •Competitive space (Celery, Rq, APScheduler exist), though this one genuinely reduces operational overhead
Target Audience

Python backend engineers, teams running PostgreSQL, DevOps looking to reduce infrastructure

Similar To

Celery · RQ · Apache Airflow

Post Description

PgQueuer turns PostgreSQL into a background job queue using LISTEN/NOTIFY and FOR UPDATE SKIP LOCKED. v0.26.0 adds an in-memory adapter so you can run the same code in tests and CI without a database. Internally it's now built on port protocols, so you can swap the persistence layer entirely.

EDIT; HN trims the full url to readme about in-memory https://github.com/janbjorge/pgqueuer?tab=readme-ov-file#in-...

Similar Projects