Job Queues

A job queue which is ORM Agnostic and has advanced Error Handling

Hansel is a pure ruby driver for httperf for automated load and performance testing. It will load a job queue file, in a yaml format, run httperf with each job.

Farmer is a nice little kit to manage a Beanstalk job queue

Job queue with MongoDB with emphasis on never losing any task even if worker fails hard (segfault).

Light weight job scheduling on top of Resque. Adds methods enqueue_at/enqueue_in to schedule jobs in the future. Also supports queueing jobs on a fixed, cron-like schedule.

Launches a Kubernetes Job when a Resque Job is enqueued, then terminates the worker when there are no more jobs in the queue.

Flamingo makes it easy to wade through the Twitter Streaming API by handling all connectivity and resource management for you. You just tell it what to track and consume the information in a resque queue. Flamingo isn't a traditional ruby gem. You don't require it into your code. Instead, it's designed to run as a daemon like redis or mysql. It provides a REST interface to change the parameters sent to the Twitter Streaming resource. All events from the streaming API are placed on a resque job queue where your application can process them. CAVEAT EMPTOR: This gem is alpha code so act accordingly.

Ensures that for a given queue, only one worker is working on a job at any given time. Example: require 'resque/plugins/unique_at_runtime' class StrictlySerialJob include Resque::Plugins::UniqueAtRuntime @queue = :serial_work def self.perform # only one at a time in this block, no parallelism allowed for this # particular queue end end

Contains libraries that support defining, queueing, and executing jobs.

Monitors the delayed_job queue and periodically tests its ability to deliver e-mail messages and e-mails you if something goes wrong, such as the delayed_job process crashes or one of its jobs fails or takes too long to complete.

An AMQP-based background worker system for Ruby designed to make managing heterogenous tasks relatively easy. The use case for Woodhouse is for reliable and sane performance in situations where jobs on a single queue may vary significantly in length. The goal is to permit large numbers of quick jobs to be serviced even when many slow jobs are in the queue. A secondary goal is to provide a sane way for jobs on a given queue to be given special priority or dispatched to a server more suited to them. Clients (i.e., your application) may be using either Ruby 1.9 in any VM.

A resque plugin that ensures job uniqueness at enqueue time.

Resque-mongo is a MongoDB-backed Ruby library for creating background jobs, placing those jobs on multiple queues, and processing them later. \ Background jobs can be any Ruby class or module that responds to perform. Your existing classes can easily be converted to background jobs or you can create new classes specifically to do work. Or, you can do both. Resque is heavily inspired by DelayedJob (which rocks) and is comprised of three parts: \ * A Ruby library for creating, querying, and processing jobs * A Rake task for starting a worker which processes jobs * A Sinatra app for monitoring queues, jobs, and workers.

MobSpawner manages worker threads that can run arbitrary commands and report results. Unlike distributed queues, MobSpawner is self-contained and perfect for small batch scripts that need to run multiple independent jobs.

A job queueing and background workers system using Beanstalkd. Inspired by the Minion gem.

Delayed_job (or DJ) encapsulates the common pattern of asynchronously executing longer tasks in the background. It is a direct extraction from Shopify where the job table is responsible for a multitude of core tasks. This gem is ajaycb's fork (http://github.com/ajaycb/delayed_job). Adds namesd queues for use in Rails 2.x

This is a Sidekiq extension that doesn't allow a job to be enqueued if it's already in the queue or being processed

A simple Resque plugin that times and saves some simple metrics for Resque jobs back into redis. Based on this system you could build some simple auto-scaling mechanism based on the speed and ETA of queues. Also includes a hook/callback mechanism for recording/sending the metrics to your favorite tool (AKA statsd/graphite).

resque plugin that allows you to attach information when a job is put in redis, and to do whatever you want with the information when it is popped off the resque queue

Have you ever had a class whose instances required a series of background tasks to run serially, strictly one after another? Than Serially is for you. Declare the tasks using a simple DSL in the order you want them to to run. The tasks for each instance will run inside a separate Resque job, in a queue you specify. The next task will run only if the previous one has finished successfully. All task runs are written to DB and can be inspected.

ProcessPool with interchangeable job queue backends for Ruby

Super simple job queue over AMQP

JobQueue means you don't have to worry about your queue any more!

A Resque plugin that provides endpoints which distributes Jobs submitted to them to (multiple) subscribing queues. Useful for loosely coupled inter-application communication.

QueueingRabbit is a Ruby library providing a flexible DSL to interact with a RabbitMQ server. Any Ruby class or Module can be transformed into QueueingRabbit's background job by including QueueingRabbit::Job module. It is also possible to inherit your class from QueueingRabbit::AbstractJob abstract class. The library is bundled with a Rake task to start a worker processing a list of specified jobs.

Define message queues. Process jobs and events. Profit.

A SQLite based, lightning fast, super efficient and dead simple to setup and use database, cache and job queue for Ruby and Rails applications!

Light weight job scheduling on top of Resque Mongo. Adds methods enqueue_at/enqueue_in to schedule jobs in the future. Also supports queueing jobs on a fixed, cron-like schedule.

Interface to pragmatically setup a queue job for Q4M!

A job queueing and background workers system using SQS. Inspired by the Stalker gem.

Komodo is a simple wrapper that allows you to scale on-demand the number of delayed_job workers on Heroku, based on the length of your queue.

A BioGem to submit jobs on a queue system

Little gem to enqueue jobs the easy way

Peon is a work queue library for Ruby with an awesome DSL for defining jobs, and it's compatible with the beanstalkd message queue.

An easy and intuitive Ruby job queue for working with parallel processes.

Resque can be very useful outside of a web app, too. What if you want to write jobs in Ruby and just enqueue them from your console? Or from a Java application? Or in cron jobs? Cavalcade to the resque! Cavalcade creates a resque-based, stand-alone job queue, and provides rake tasks to enqueue all of your jobs.

Job locking for que jobs such that only one can be in the queue or executing at once.

noda is job queue system using druby

resque-throttle is an extension to the resque queue system that restricts the frequency in which certain jobs are run. Add more description here.

If you are using ActiveJob with the Resque Adapter, this gem will prevent jobs, based on arguments, from being enqueued to Resque as long as a duplicate is already in queue or executing on a worker.

JobQueue means you don't have to worry about your queue any more!

Light weight job scheduling on top of Resque. Adds methods enqueue_at/enqueue_in to schedule jobs in the future. Also supports queueing jobs on a fixed, cron-like schedule.

Light weight job scheduling on top of Resque. Adds methods enqueue_at/enqueue_in to schedule jobs in the future. Also supports queueing jobs on a fixed, cron-like schedule.

Resque is a Redis-backed Ruby library for creating background jobs, placing those jobs on multiple queues, and processing them later. Background jobs can be any Ruby class or module that responds to perform. Your existing classes can easily be converted to background jobs or you can create new classes specifically to do work. Or, you can do both. Resque is heavily inspired by DelayedJob (which rocks) and is comprised of three parts: * A Ruby library for creating, querying, and processing jobs * A Rake task for starting a worker which processes jobs * A Sinatra app for monitoring queues, jobs, and workers.

Offload CarrierWave's image processing and storage to a background process using Delayed Job, Resque, Sidekiq, Qu, Queue Classic or Girl Friday

Message provides flexible & reliable background/asynchronous job processing mechanism on top of simple queue interface. Any developer can create queue adapter for Message to hook up different messaging/queue system. One in-memory queue is included with Message for you to start development and test, and you can easily swap in other queues later.

An ActiveRecord job queueing system

Asynchronous job processing using the beanstalkd queue server with automatic reconnects and failover

An extension for Sidekiq allowing jobs in a single queue to be executed by a priority score rather than FIFO

Super simple job queue over AMQP