async-task-q
Advanced tools
A modern, async-first, type-safe task queue Python package inspired by Laravel. Native FastAPI integration. Switch between multiple queue backends (Memory, Redis, PostgreSQL, MySQL, RabbitMQ, AWS SQS) with one config line. Automatic, smart ORM serialization using msgpack reduces payloads by 90%+.
A modern, async-first, type-safe task queue Python package inspired by Laravel. Native FastAPI integration. Switch between multiple queue backends (Redis, PostgreSQL, MySQL, RabbitMQ, AWS SQS) with one config line. Automatic ORM serialization (SQLAlchemy, Django, Tortoise) using msgpack reduces payloads by 90%+. Features ACID guarantees, dead-letter queues, crash recovery.
use_bin_type=True for optimal bytes processingshould_retry() hooks.delay(60).on_queue("high").dispatch()✅ Async-first design with asyncio throughout the stack
✅ Multiple queue drivers: Redis, PostgreSQL, MySQL, RabbitMQ, AWS SQS
✅ High-performance msgpack serialization with binary support
✅ Automatic ORM model handling for SQLAlchemy, Django, Tortoise
✅ Type-safe with full type hints and Generic support
✅ Configurable retries with custom retry logic hooks
✅ Task timeouts to prevent runaway tasks
✅ Delayed task execution with precision timing
✅ Queue priority with multiple queues per worker
✅ Graceful shutdown with signal handlers
✅ ACID guarantees (PostgreSQL/MySQL drivers)
✅ Dead-letter queues for failed task inspection
✅ Visibility timeouts for crash recovery
✅ Connection pooling for optimal resource usage
✅ Transactional dequeue with SELECT FOR UPDATE SKIP LOCKED
✅ Task metadata tracking (attempts, timestamps, task IDs)
✅ Concurrent processing with configurable worker concurrency
✅ FastAPI – Automatic lifecycle management, dependency injection
✅ SQLAlchemy – Async and sync model serialization
✅ Django ORM – Native async support (Django 3.1+)
✅ Tortoise ORM – Full async ORM integration
✅ Comprehensive CLI – Worker management and database migrations
✅ Function-based tasks with @task decorator
✅ Class-based tasks with lifecycle hooks (handle, failed, should_retry)
✅ Method chaining for fluent task configuration
✅ Environment variable configuration for 12-factor apps
Get started in 60 seconds:
# Install Async Task Q
uv add async-task-q[redis]
import asyncio
from async_task_q.config import set_global_config
from async_task_q.core.task import task
# 1. Configure (or use environment variables)
set_global_config(driver="redis", redis_url="redis://localhost:6379", redis_password=None)
# 2. Define a task
@task
async def send_email(to: str, subject: str, body: str):
print(f"Sending email to {to}: {subject}")
await asyncio.sleep(1) # Simulate email sending
return f"Email sent to {to}"
# 3. Dispatch the task
async def main():
for i in range(10):
task_id = await send_email.dispatch(
to=f"user{i}@example.com", subject=f"Welcome {i}!", body="Welcome to our platform!"
)
print(f"Task dispatched: {task_id}")
if __name__ == "__main__":
asyncio.run(main())
# Run the worker
python -m async_task_q worker
That's it! Your first async task queue is ready. Now let's explore the powerful features.
just init — install deps and pre-commit hooksjust services-up — Redis, PostgreSQL, MySQL, RabbitMQ, LocalStack (SQS) for local integration testsjust test (or pytest) — use just test-unit / just test-integration to scopejust test-cov or pytest --cov=src/async_task_q --cov-report=htmlpython -m async_task_q worker./setup-pre-commit.sh or just setup-hooksjust format, just lint, just typecheckmain and includes lint, type checks and tests across Python 3.11–3.14../setup-pre-commit.sh).main..github/coverage.svg automatically via .github/workflows/coverage-badge.yml.just ci (runs format/lint/typecheck/tests like the workflow).| Feature | Async Task Q | Celery |
|---|---|---|
| Async Support | ✅ Async-first, built with asyncio | ❌ No native asyncio support |
| Type Safety | ✅ Full type hints, Generic[T] | ⚠️ Third-party stubs (celery-types) |
| Multi-Driver | ✅ 5 drivers (Redis/PostgreSQL/MySQL/RabbitMQ/SQS) | ⚠️ Redis/RabbitMQ/SQS brokers |
| ORM Integration | ✅ Auto-serialization (SQLAlchemy/Django/Tortoise) | ❌ Manual serialization |
| Serialization | ✅ msgpack (fast, binary) | ⚠️ JSON/pickle (slower) |
| FastAPI Integration | ✅ First-class, lifespan management | ⚠️ Manual setup |
| Dead-Letter Queue | ✅ Built-in (PG/MySQL) | ⚠️ Manual setup (RabbitMQ DLX) |
| ACID Guarantees | ✅ PostgreSQL/MySQL drivers | ❌ Not available |
| Setup Complexity | ✅ Zero-config with env vars | ⚠️ Complex configuration |
| Learning Curve | ✅ Simple, intuitive API | ⚠️ Steep learning curve |
When to use Async Task Q:
When to use Celery:
| Feature | Async Task Q | Dramatiq |
|---|---|---|
| Async Support | ✅ Async-first | ⚠️ Limited (via middleware) |
| Type Safety | ✅ Full type hints | ✅ Type hints (py.typed) |
| Multi-Driver | ✅ 5 drivers | ⚠️ Redis/RabbitMQ |
| ORM Integration | ✅ Auto-serialization | ❌ Manual serialization |
| Dead-Letter Queue | ✅ Built-in | ✅ Built-in |
| FastAPI Integration | ✅ First-class | ⚠️ Manual setup |
| Database Drivers | ✅ PostgreSQL/MySQL | ❌ Not available |
| Simplicity | ✅ Clean, intuitive API | ✅ Simple, well-designed |
When to use Async Task Q:
When to use Dramatiq:
| Feature | Async Task Q | RQ |
|---|---|---|
| Async Support | ✅ Async-first | ❌ Sync only |
| Multi-Driver | ✅ 5 drivers | ❌ Redis only |
| Type Safety | ✅ Full type hints | ✅ Type hints added |
| Retries | ✅ Configurable with custom logic | ✅ Configurable retries |
| Dead-Letter Queue | ✅ Built-in | ❌ Not available |
| Database Drivers | ✅ PostgreSQL/MySQL | ❌ Not available |
| Simplicity | ✅ Intuitive, clean API | ✅ Very simple |
When to use Async Task Q:
When to use RQ:
| Feature | Async Task Q | Huey |
|---|---|---|
| Async Support | ✅ Async-first | ⚠️ Limited async |
| Multi-Driver | ✅ 5 drivers | ⚠️ Redis/SQLite |
| Type Safety | ✅ Full type hints | ❌ Limited |
| ORM Integration | ✅ Auto-serialization | ❌ Manual |
| Enterprise Features | ✅ ACID, DLQ, visibility timeout | ⚠️ Basic features |
| Simplicity | ✅ Clean, modern API | ✅ Simple |
When to use Async Task Q:
When to use Huey:
Async Task Q stands out with:
For detailed documentation, see the following guides:
For complete examples, see the following guides:
Contributions are welcome! Please see CONTRIBUTING.md for guidelines.
MIT License – see LICENSE file for details.
Built with ❤️ by Adam Refaey.
FAQs
A modern, async-first, type-safe task queue Python package inspired by Laravel. Native FastAPI integration. Switch between multiple queue backends (Memory, Redis, PostgreSQL, MySQL, RabbitMQ, AWS SQS) with one config line. Automatic, smart ORM serialization using msgpack reduces payloads by 90%+.
We found that async-task-q demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
GitHub has revoked npm classic tokens for publishing; maintainers must migrate, but OpenJS warns OIDC trusted publishing still has risky gaps for critical projects.
Security News
Rust’s crates.io team is advancing an RFC to add a Security tab that surfaces RustSec vulnerability and unsoundness advisories directly on crate pages.
Security News
/Research
Socket found a Rust typosquat (finch-rust) that loads sha-rust to steal credentials, using impersonation and an unpinned dependency to auto-deliver updates.