
Research
/Security News
Toptal’s GitHub Organization Hijacked: 10 Malicious Packages Published
Threat actors hijacked Toptal’s GitHub org, publishing npm packages with malicious payloads that steal tokens and attempt to wipe victim systems.
promise-streams
Advanced tools
A collection of streams that work well with promises (through, map, reduce)
A collection of streams that work well with promises (through, map, reduce)
Using ES6 arrow functions:
var Promise = require('bluebird'),
request = require('request'),
path = require('path'),
fs = require('fs'),
ps = require('promise-streams'),
select = require('./select-elements');
Promise.promisifyAll(request);
var download = url =>
ps.wait(request('http:' + url).pipe(
fs.createWriteStream(
'images/' + path.basename(url))));
var downloadAllFrom = url =>
request(url)
.pipe(select('.post a img', el => el.attributes.SRC))
.pipe(ps.filter(url => /jpg$/.test(url.toLowerCase()))
.pipe(ps.map({concurrent: 4}, imgurl => download(imgurl, url)))
.reduce((count, stream) => count + 1, 0);
downloadAllFrom('http://imgur.com/').done(
total => console.log(total, "images downloaded"),
err => console.error(err.stack))
([opts:Options,] fn:(data[, enc]) => Promise)) => PromiseStream
Create a through-promise stream. Pass it a function that takes data and
encoding and uses this.push
to push values or promises. This function should
return a promise that indicates when the object/chunk are fully processed.
Returns a PromiseStream.
Options:
concurrent
- The maximum number of concurrent promises that are allowed.
When this limit is reached, the stream will stop processing data and will
start buffering incoming objects. Defaults to 1
highWatermark
- the size (in objects) of the buffer mentioned above. When
this buffer fills up, the backpressure mechanism will activate. Its passed
to node's transform stream.
The other options are also passed to node's Transform stream constructor.
([opts:Options,] fn: (data[, enc]) => Promise) => MapPromiseStream
Create a new MapPromiseStream. The function should return a promise for the next object that will be pushed to the stream.
Options: Same as ps.through
([opts:Options,] fn: (data[, enc]) => boolean) => FilterPromiseStream
Create a new FilterPromiseStream. The function should return a boolean to indicate whether the data value should pass to the next stream
Options: Same as ps.through
([opts:Options,] fn: (acc, data[, enc]) => Promise) => ReducePromiseStream
Reduces the objects in this promise stream. The function takes the resolved current accumulator and data object and should return the next accumulator or a promise for the next accumulator.
The ReducePromiseStream has a promise()
method which returns the final
accumulator value
process.stdin.pipe(split()).pipe(es.reduce(function(acc, el) {
return acc + el;
})).promise().then(function(sum) {
});
(s: Stream) => Promise
Wait for the stream to end. Also captures errors.
(s: Stream) => Promise<Buffer | string>
Collects data from a stream into a single buffer or string, depending on the encoding of the passed stream.
(source: Stream, destination: Stream) => Promise
Pipes s1 to s2 and forwards all errors to the resulting promise. The promise is fulfilled without a value when the source stream ends.
(source: Stream, ...streams: Stream[]) => Promise
Like pipe, but creates a pipeline of multiple streams.
Like this.push
in through2, but takes promise
arguments. It returns a promise that resolves when the pushed promise resolves,
to make it possible to use return this.push(data)
([opts:Options,] fn: (data[, enc]) => Promise) => MapPromiseStream
Create a new MapPromiseStream and pipes this promise stream to it.
([opts:Options,] fn: (data[, enc]) => boolean) => FilterPromiseStream
Create a new FilterPromiseStream and pipes this promise stream to it.
([opts:Options,] fn: (acc, data[, enc]) => Promise) => Promise
Reduces the objects in this promise stream. The function takes the resolved current accumulator and data object and should return the next accumulator or a promise for the next accumulator.
Returns a promise for the final reduction result
() => Promise
Returns a promise fulfilled at the end of the stream, rejected if any errors events are emitted by the stream.
For ReducePromiseStreams, the promise is for the final reduction result. Any stream errors or exceptions encountered while reducing will result with a rejection of the promise.
FAQs
A collection of streams that work well with promises (through, map, reduce)
The npm package promise-streams receives a total of 219 weekly downloads. As such, promise-streams popularity was classified as not popular.
We found that promise-streams demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
/Security News
Threat actors hijacked Toptal’s GitHub org, publishing npm packages with malicious payloads that steal tokens and attempt to wipe victim systems.
Research
/Security News
Socket researchers investigate 4 malicious npm and PyPI packages with 56,000+ downloads that install surveillance malware.
Security News
The ongoing npm phishing campaign escalates as attackers hijack the popular 'is' package, embedding malware in multiple versions.