Queue

QueueingRabbit is a Ruby library providing a flexible DSL to interact with a RabbitMQ server. Any Ruby class or Module can be transformed into QueueingRabbit's background job by including QueueingRabbit::Job module. It is also possible to inherit your class from QueueingRabbit::AbstractJob abstract class. The library is bundled with a Rake task to start a worker processing a list of specified jobs.

Resque is a Redis-backed Ruby library for creating background jobs, placing those jobs on multiple queues, and processing them later. Mongo-Resque is the same thing, but for mongo. It would not exist without the work of defunkt and ctrochalakis on github.

depq is a Double-Ended Priority Queue library. It is a data structure which can insert elements and delete elements with minimum and maximum priority. If there are elements which has same priority, the element inserted first is chosen. The priority can be changed after the element is inserted.

Timberline is a simple and extensible queuing system built in Ruby and backed by Redis. It makes as few assumptions as possible about how you want to interact with your queues while also allowing for some functionality that should be universally useful, like allowing for automatic retries of jobs and queue statistics.

Avoid writing boilerplate code in order to consume messages from an AMQP message queue. Plug in queue configuration, and how to process each message.

nfqueue is a tiny wrapper around libnetfilter_queue. It allows you to very simply intercept and modify network traffic in a Ruby environment.

Queue tracking of users who need debugging help with per-channel management

Gem to handle the implementation of http://queue-it.net!

Resque queue backed by database audits, with automatic retry

Job queue system to run job with Docker

Easy message queues for ruby using AMQ, STOMP and others

Individual failed queue for each queue you have

OpeNER daemon for processing multiple queues at once

# Sparrow is a really fast lightweight queue written in Ruby that speaks memcached. # That means you can use Sparrow with any memcached client library (Ruby or otherwise). # # Basic tests shows that Sparrow processes messages at a rate of 850-900 per second. # The load Sparrow can cope with increases exponentially as you add to the cluster. # Sparrow also takes advantage of eventmachine, which uses a non-blocking io, offering great performance. # # Sparrow is a in-memory queue but will persist the data to disk when receiving a term signal. # # Sparrow comes with built in support for daemonization and clustering. # Also included are example libraries and clients. For example: # # require 'memcache' # m = MemCache.new('127.0.0.1:11212') # m['queue_name'] = '1' # Publish to queue # m['queue_name'] #=> 1 Pull next msg from queue # m['queue_name'] #=> nil # m.delete('queue_name) # Delete queue # # # or using the included client: # # class MyQueue < MQ3::Queue # def on_message # logger.info "Received msg with args: #{args.inspect}" # end # end # # MyQueue.servers = [ # MQ3::Protocols::Memcache.new({:host => '127.0.0.1', :port => 11212, :weight => 1}) # ] # MyQueue.publish('test msg') # MyQueue.run # # Messages are deleted as soon as they're read and the order you add messages to the queue probably won't # be the same order when they're removed. # # Additional memcached commands that are supported are: # flush_all # Deletes all queues # version # quit # The memcached commands 'add', and 'replace' just call 'set'. # # Call sparrow with --help for usage options # # The daemonization won't work on Windows. # # Check out the code: # svn checkout http://sparrow.googlecode.com/svn/trunk/ sparrow # # Sparrow was inspired by Twitter's Starling

A resque plugin that ensures job uniqueness at enqueue time.

Queues system for AR/Rails based on PgQ Skytools for PostgreSQL, like Resque on Redis. Rails 2.3 and 3 compatible.

Apphunkd is a ruby based daemon that runs on your application-servers and acts as local proxy between your apps and apphunk.com. It collects, queues and delivers message to the Apphunk remote-logging-service.

Edamame combines the Beanstalk priority queue with a Tokyo Tyrant database and God monitoring to produce a persistent distributed priority job queue system. Like beanstalk, it is fast, lightweight, distributed, priority queuing, reliable scheduling; it adds persistence, named jobs and job querying/enumeration.

A sortable and searchable list backed by Redis. You can use it as a quick actionable workflow queue which you can search/sort and paginate thorough

This gem makes it possible to send mails asynchronously using Resque by simply rewriting `SomeMailer.some_mail(ar_resource, 1234).deliver` to `SomeMailer.async_deliver.some_mail(ar_resource, 1234)`. Using ActiveRecord objects as arguments to mailers is still possible. This is achieved by storing the class name and the record id as arguments in the Resque queue which will be transformed back to records by the mailer job and passed along to the mailer.

A gem for processing tasks asynchronously, powered by RabbitMQ.

The Cloudq Client gem is an awesome client interface to the cloudq a remote job queue engine that allows you to publish jobs and subscribe from jobs anywhere in the cloud....

A work dispatcher and some queue implementations

A simple event bus on top of Sidekiq. Publish and subscribe to events as they occur through a queue.

A job queue which is ORM Agnostic and has advanced Error Handling

Hansel is a pure ruby driver for httperf for automated load and performance testing. It will load a job queue file, in a yaml format, run httperf with each job.

A simple priority queue in Ruby.

Farmer is a nice little kit to manage a Beanstalk job queue

Implements a simple protocol for using message queues, with adapters for ActiveMQ, Spread and stdio (for testing).

Queue any method in any class or instance with no need for additional Worker class and no extra code

Automatically move events from one redis queue to the same queue on another server

Queue_Dispatcher executes asynchronous tasks in the background.

File based queue for coordinating multiple processes.

Generic approval queues for record creation and updates

A rather direct provisioning and deployment system in ruby, bash over ssh, and rsync. SyncWrap is a refreshingly straightforward, DSL-free non-framework with no central server or repository requirements. The "magic", if any, lies in the elegant component model, the shell command queue, and a few powerful methods like rput (augmented rsync).

Job queue with MongoDB with emphasis on never losing any task even if worker fails hard (segfault).

A sidekiq plugin for specifying the queues a worker pulls from with wildcards, negations, or dynamic look up from redis

* Like TiVo for your data * A distributed rewindable multi-queue

JobQueue means you don't have to worry about your queue any more!

Unique Resque queues using redis 1.6.0 scripting, sets and not much else

Tengine Event API to access the queue

Take a peek into your Resque queues and workers.

Log HTTP request queue time to statsd when the HTTP_X_REQUEST_START is set.

Light weight job scheduling on top of Resque. Adds methods enqueue_at/enqueue_in to schedule jobs in the future. Also supports queueing jobs on a fixed, cron-like schedule.

Launches a Kubernetes Job when a Resque Job is enqueued, then terminates the worker when there are no more jobs in the queue.

The project implements a queue system with a server and some client apis. This project wants to be a fast and lightweight implementation with most of the features of MQS or ActiveMQ.

== DESCRIPTION: The RightScale AWS gems have been designed to provide a robust, fast, and secure interface to Amazon EC2, EBS, S3, SQS, SDB, and CloudFront. These gems have been used in production by RightScale since late 2006 and are being maintained to track enhancements made by Amazon. The RightScale AWS gems comprise: - RightAws::Ec2 -- interface to Amazon EC2 (Elastic Compute Cloud) and the associated EBS (Elastic Block Store) - RightAws::S3 and RightAws::S3Interface -- interface to Amazon S3 (Simple Storage Service) - RightAws::Sqs and RightAws::SqsInterface -- interface to first-generation Amazon SQS (Simple Queue Service) (API version 2007-05-01) - RightAws::SqsGen2 and RightAws::SqsGen2Interface -- interface to second-generation Amazon SQS (Simple Queue Service) (API version 2008-01-01) - RightAws::SdbInterface and RightAws::ActiveSdb -- interface to Amazon SDB (SimpleDB) - RightAws::AcfInterface -- interface to Amazon CloudFront, a content distribution service == FEATURES:

Broadcast wisper events into activejob queues

Library for pushing messages onto and off RabbitMQ queues

Queue Map