Product
Introducing License Enforcement in Socket
Ensure open-source compliance with Socket’s License Enforcement Beta. Set up your License Policy and secure your software!
BullMQ is a powerful, fast, and feature-rich library for handling distributed job queues in Node.js. It is built on top of Redis and provides a robust set of features for managing background jobs, scheduling tasks, and handling concurrency.
Job Queue Management
BullMQ allows you to create and manage job queues. You can add jobs to a queue and process them using workers. This is useful for offloading tasks that can be processed asynchronously.
const { Queue, Worker } = require('bullmq');
const myQueue = new Queue('my-queue');
// Adding a job to the queue
myQueue.add('my-job', { foo: 'bar' });
// Processing jobs from the queue
const worker = new Worker('my-queue', async job => {
console.log(job.name); // 'my-job'
console.log(job.data); // { foo: 'bar' }
});
Job Scheduling
BullMQ supports job scheduling, allowing you to delay the execution of jobs. This is useful for tasks that need to be executed at a later time.
const { Queue } = require('bullmq');
const myQueue = new Queue('my-queue');
// Scheduling a job to run in 5 seconds
myQueue.add('my-delayed-job', { foo: 'bar' }, { delay: 5000 });
Concurrency Control
BullMQ allows you to control the concurrency of job processing. You can specify the number of jobs that can be processed simultaneously by a worker.
const { Worker } = require('bullmq');
// Creating a worker with concurrency of 5
const worker = new Worker('my-queue', async job => {
console.log(job.name);
}, { concurrency: 5 });
Job Retries
BullMQ provides options for retrying failed jobs. You can specify the number of retry attempts and the backoff time between retries.
const { Queue } = require('bullmq');
const myQueue = new Queue('my-queue');
// Adding a job with retry options
myQueue.add('my-retry-job', { foo: 'bar' }, { attempts: 3, backoff: 5000 });
Kue is a priority job queue backed by Redis, built for Node.js. It provides a simple API for creating and processing jobs, but it lacks some of the advanced features and performance optimizations found in BullMQ.
Agenda is a lightweight job scheduling library for Node.js. It uses MongoDB for persistence and provides a simple API for defining and scheduling jobs. While it is easy to use, it does not offer the same level of performance and scalability as BullMQ.
Bee-Queue is a simple, fast, and robust job/task queue for Node.js, backed by Redis. It is designed for high performance and low latency, but it does not have as many features as BullMQ, such as job scheduling and advanced concurrency control.
The fastest, most reliable, Redis-based distributed queue for Node.
Carefully written for rock solid stability and atomicity.
Follow @manast for *important* Bull/BullMQ news and updates!
You can find tutorials and news in this blog: https://blog.taskforce.sh/
Supercharge your queues with a profesional front end and optional Redis hosting:
Sign up at Taskforce.sh
Install:
$ yarn add bullmq
Add jobs to the queue:
import { Queue } from 'bullmq';
const queue = new Queue('Paint');
queue.add('cars', { color: 'blue' });
Process the jobs in your workers:
import { Worker } from 'bullmq';
const worker = new Worker('Paint', async job => {
if (job.name === 'cars') {
await paintCar(job.data.color);
}
});
Listen to jobs for completion:
import { QueueEvents } from 'bullmq';
const queueEvents = new QueueEvents('Paint');
queueEvents.on('completed', jobId => {
console.log('done painting');
});
queueEvents.on('failed', (jobId, err) => {
console.error('error painting', err);
});
This is just scratching the surface, check all the features and more in the official documentation
Thanks for all the contributors that made this library possible, also a special mention to Leon van Kammen that kindly donated his npm bullmq repo.
FAQs
Queue for messages and jobs based on Redis
We found that bullmq demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Product
Ensure open-source compliance with Socket’s License Enforcement Beta. Set up your License Policy and secure your software!
Product
We're launching a new set of license analysis and compliance features for analyzing, managing, and complying with licenses across a range of supported languages and ecosystems.
Product
We're excited to introduce Socket Optimize, a powerful CLI command to secure open source dependencies with tested, optimized package overrides.