stream-transform
Advanced tools
Package description
The stream-transform package is a simple and powerful tool for transforming data in Node.js streams. It allows you to easily modify data as it passes through a stream, making it highly useful for tasks such as data manipulation, filtering, and aggregation in real-time data processing applications.
Synchronous Transformation
This feature allows for synchronous data transformation within a stream. The provided code sample demonstrates how to read data from a CSV file, transform each record by joining its elements with a space, and then output the transformed data.
const transform = require('stream-transform');
const transformer = transform(function(record, callback){
setTimeout(function(){
callback(null, record.join(' ') + '\n');
}, 500);
}, {parallel: 5});
require('fs').createReadStream('/path/to/source.csv').pipe(transformer).pipe(process.stdout);Asynchronous Transformation
This feature supports asynchronous transformation of stream data. The code sample shows how to asynchronously convert each piece of data to uppercase before passing it through the stream.
const transform = require('stream-transform');
const transformer = transform(function(record, callback){
process.nextTick(function(){
callback(null, record.toUpperCase());
});
});
require('fs').createReadStream('/path/to/source.txt').pipe(transformer).pipe(process.stdout);Through2 is a tiny wrapper around Node.js streams.Transform that makes it easier to create transform streams. It is similar to stream-transform in providing a simple API for data transformation but differs in its implementation and customization options.
Event-stream is a toolkit for working with Node.js streams in a functional programming style, offering a variety of utilities for creating, combining, and consuming streams. While it provides more general stream manipulation capabilities, it shares the ability to transform stream data with stream-transform.
Readme
The stream-transform project is a simple object transformation framework. It is part of the CSV project.
The Node.js stream.Transform API is implemented for scalability. The callback-based and sync APIs are also available for convenience. It is both easy to use and powerful.
Run npm install csv to install the full CSV module or run npm install csv-transform if you are only interested by the CSV stringifier.
The module is built on the Node.js Stream API. Use the callback and sync APIs for simplicity or the stream based API for scalability.
The API is available in multiple flavors. This example illustrates the sync API.
import { transform } from 'stream-transform/sync';
import assert from 'assert';
const records = transform([
[ 'a', 'b', 'c', 'd' ],
[ '1', '2', '3', '4' ]
], function(record){
record.push(record.shift());
return record;
});
assert.deepEqual(records, [
[ 'b', 'c', 'd', 'a' ],
[ '2', '3', '4', '1' ]
]);
Tests are executed with mocha. To install it, simple run npm install followed by npm test. It will install mocha and its dependencies in your project "node_modules" directory and run the test suite. The tests run against the CoffeeScript source files.
To generate the JavaScript files, run npm run coffee.
The test suite is run online with Travis. See the Travis definition file to view the tested Node.js version.
The project is sponsored by Adaltas, an Big Data consulting firm based in Paris, France.
FAQs
Object transformations implementing the Node.js `stream.Transform` API
The npm package stream-transform receives a total of 1,092,383 weekly downloads. As such, stream-transform popularity was classified as popular.
We found that stream-transform demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
As cyber threats become more autonomous, AI-powered defenses are crucial for businesses to stay ahead of attackers who can exploit software vulnerabilities at scale.
Security News
UnitedHealth Group disclosed that the ransomware attack on Change Healthcare compromised protected health information for millions in the U.S., with estimated costs to the company expected to reach $1 billion.
Security News
GitHub is susceptible to a CDN flaw that allows attackers to host malware on any public repository.