Streaming

Official AWS Ruby gem for Amazon Transcribe Streaming Service. This gem is part of the AWS SDK for Ruby.

Ruby C bindings to the excellent Yajl JSON stream-based parser library.

Amazon Web Services event stream library. Decodes and encodes binary stream under `vnd.amazon.event-stream` content-type

Official AWS Ruby gem for Managed Streaming for Kafka (Kafka). This gem is part of the AWS SDK for Ruby.

Official AWS Ruby gem for Amazon DynamoDB Streams. This gem is part of the AWS SDK for Ruby.

== DESCRIPTION: The RightScale AWS gems have been designed to provide a robust, fast, and secure interface to Amazon EC2, EBS, S3, SQS, SDB, and CloudFront. These gems have been used in production by RightScale since late 2006 and are being maintained to track enhancements made by Amazon. The RightScale AWS gems comprise: - RightAws::Ec2 -- interface to Amazon EC2 (Elastic Compute Cloud) and the associated EBS (Elastic Block Store) - RightAws::S3 and RightAws::S3Interface -- interface to Amazon S3 (Simple Storage Service) - RightAws::Sqs and RightAws::SqsInterface -- interface to first-generation Amazon SQS (Simple Queue Service) (API version 2007-05-01) - RightAws::SqsGen2 and RightAws::SqsGen2Interface -- interface to second-generation Amazon SQS (Simple Queue Service) (API version 2008-01-01) - RightAws::SdbInterface and RightAws::ActiveSdb -- interface to Amazon SDB (SimpleDB) - RightAws::AcfInterface -- interface to Amazon CloudFront, a content distribution service == FEATURES: - Full programmmatic access to EC2, EBS, S3, SQS, SDB, and CloudFront. - Complete error handling: all operations check for errors and report complete error information by raising an AwsError. - Persistent HTTP connections with robust network-level retry layer using RightHttpConnection). This includes socket timeouts and retries. - Robust HTTP-level retry layer. Certain (user-adjustable) HTTP errors returned by Amazon's services are classified as temporary errors. These errors are automaticallly retried using exponentially increasing intervals. The number of retries is user-configurable. - Fast REXML-based parsing of responses (as fast as a pure Ruby solution allows). - Uses libxml (if available) for faster response parsing. - Support for large S3 list operations. Buckets and key subfolders containing many (> 1000) keys are listed in entirety. Operations based on list (like bucket clear) work on arbitrary numbers of keys. - Support for streaming GETs from S3, and streaming PUTs to S3 if the data source is a file. - Support for single-threaded usage, multithreaded usage, as well as usage with multiple AWS accounts. - Support for both first- and second-generation SQS (API versions 2007-05-01 and 2008-01-01). These versions of SQS are not compatible. - Support for signature versions 0 and 1 on SQS, SDB, and EC2. - Interoperability with any cloud running Eucalyptus (http://eucalyptus.cs.ucsb.edu) - Test suite (requires AWS account to do "live" testing).

A Rack app that provides request/response rewriting proxy capabilities with streaming.

Shrine is a toolkit for file attachments in Ruby applications. It supports uploading, downloading, processing and deleting IO objects, backed by various storage engines. It uses efficient streaming for low memory usage. Shrine comes with a high-level interface for attaching uploaded files to database records, saving their location and metadata to a database column, and tying them to record's lifecycle. It natively supports background jobs and direct uploads for fully asynchronous user experience.

Robust streaming downloads using Net::HTTP, HTTP.rb or wget.

Rightscale::HttpConnection is a robust HTTP/S library. It implements a retry algorithm for low-level network errors. == FEATURES: - provides put/get streaming - does configurable retries on connect and read timeouts, DNS failures, etc. - HTTPS certificate checking

Official AWS Ruby gem for Amazon Kinesis Video Streams (Kinesis Video). This gem is part of the AWS SDK for Ruby.

Official AWS Ruby gem for Amazon Kinesis Video Streams Archived Media (Kinesis Video Archived Media). This gem is part of the AWS SDK for Ruby.

Official AWS Ruby gem for Amazon Kinesis Video Streams Media (Kinesis Video Media). This gem is part of the AWS SDK for Ruby.

Streaming proxy for Rack, the rainbows to Rack::Proxy's unicorn.

Official AWS Ruby gem for Managed Streaming for Kafka Connect (Kafka Connect). This gem is part of the AWS SDK for Ruby.

TweetStream is a simple wrapper for consuming the Twitter Streaming API.

Simple Ruby client library for twitter streaming API. Uses EventMachine for connection handling. Adheres to twitter's reconnection guidline. JSON format only.

A Ruby gem that streams and parses large Excel(xlsx and xlsm) files fast and efficiently.

sequel_pg overwrites the inner loop of the Sequel postgres adapter row fetching code with a C version. The C version is significantly faster than the pure ruby version that Sequel uses by default. sequel_pg also offers optimized versions of some dataset methods, as well as adds support for using PostgreSQL streaming.

Fluentd output plugin which detects exception stack traces in a stream of JSON log messages and combines all single-line messages that belong to the same stack trace into one multi-line message. This is an official Google Ruby gem.

Google Speech-to-Text enables developers to convert audio to text by applying powerful neural network models in an easy-to-use API. The API recognizes more than 120 languages and variants to support your global user base. You can enable voice command-and-control, transcribe audio from call centers, and more. It can process real-time streaming or prerecorded audio, using Google's machine learning technology.

Persistent event repository implementation for RubyEventStore based on ActiveRecord. Ships with database schema and migrations suitable for PostgreSQL, MySQL ans SQLite database engines. Includes repository implementation with linearized writes to achieve log-like properties of streams on top of SQL database engine.

Event browser companion application for RubyEventStore. Inspect stream contents and event details. Explore correlation and causation connections.

Stream out ZIP files from Ruby

A parser best suited for huge JSON documents that don't fit in memory.

Social Stream is a Ruby on Rails engine providing your application with social networking features and activity streams. This gem packages the basic functionality, along with basic actors (user, group) and activity objects (post and comments)

Detects objects, explicit content, and scene changes in videos. It also specifies the region for annotation and transcribes speech to text. Supports both asynchronous API and streaming API.

a module for streaming dynamically generated zip files

This gem is a logstash plugin required to be installed on top of the Logstash core pipeline using $LS_HOME/bin/plugin install gemname. This gem is not a stand-alone program

Input and Output streaming for Ruby.

Fluentd plugin to store data on Google BigQuery, by load, or by stream inserts

Social Stream is a Ruby on Rails engine for building social network websites. It supports contacts, posts, file uploads, private messages and much more.

Norikra is a open source server software provides "Schema-les Stream Processing" with SQL, written in JRuby, runs on JVM, licensed under GPLv2.

em-eventsource is an eventmachine library to consume Server-Sent Events streaming API. You can find the specification here: http://dev.w3.org/html5/eventsource/

Saxerator is a streaming xml-to-hash parser designed for working with very large xml files by giving you Enumerable access to manageable chunks of the document.

Social Stream Presence provides everything you need for including presence, instant messaging and video chat services in your social network website, including a complete chat fully integrated with Social Stream.

Google Speech-to-Text enables developers to convert audio to text by applying powerful neural network models in an easy-to-use API. The API recognizes more than 120 languages and variants to support your global user base. You can enable voice command-and-control, transcribe audio from call centers, and more. It can process real-time streaming or prerecorded audio, using Google's machine learning technology. Note that google-cloud-speech-v1 is a version-specific client library. For most uses, we recommend installing the main client library google-cloud-speech instead. See the readme for more details.

Google Speech-to-Text enables developers to convert audio to text by applying powerful neural network models in an easy-to-use API. The API recognizes more than 120 languages and variants to support your global user base. You can enable voice command-and-control, transcribe audio from call centers, and more. It can process real-time streaming or prerecorded audio, using Google's machine learning technology. Note that google-cloud-speech-v1p1beta1 is a version-specific client library. For most uses, we recommend installing the main client library google-cloud-speech instead. See the readme for more details.

Ruby client for the NATS Streaming messaging system.

WebVTT parser and segmenter in ruby for HTML5 and HTTP Live Streaming (HLS).

Generate and parse m3u8 playlists for HTTP Live Streaming (HLS).

Twitter Streaming API client for EventMachine

Ruby client for getstream.io service

Graham Cormode and S. Muthukrishnan's Effective Computation of Biased Quantiles over Data Streams in ICDE’05

Ruby bindings for Libarchive. Libarchive is a programming library that can create and read several different streaming archive formats, including most popular tar variants, several cpio formats, and both BSD and GNU ar variants.

Tapout is a TAP consumer that can take any TAP, TAP-Y or TAP-J stream and output it in a variety of useful formats.

Social Stream is a Ruby on Rails engine providing your application with social networking features and activity streams. This gem allow you upload almost any kind of file as new social stream activity.

Persistent event repository implementation for RubyEventStore based on ActiveRecord. Ships with database schema and migrations suitable for PostgreSQL, MySQL ans SQLite database engines. Includes repository implementation with linearized writes to achieve log-like properties of streams on top of SQL database engine.

Social Stream is a Ruby on Rails engine providing your application with social networking features and activity streams. This gem allow you to add events as a new social stream activity, with a calendar-supported management

Treat your dataset like a: * stream of lines when it's efficient to process by lines * stream of field arrays when it's efficient to deal directly with fields * stream of lightweight objects when it's efficient to deal with objects Wukong is friends with Hadoop the elephant, Pig the query language, and the cat on your command line.