Security News
tea.xyz Spam Plagues npm and RubyGems Package Registries
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
checkpoint-stream
Advanced tools
Readme
Queue data from a stream until a checkpoint is hit
$ npm install --save checkpoint-stream
var checkpoint = require('checkpoint-stream')
// getObjectsStream() returns a stream that emits multiple objects
// this will queue up those objects until we reach a checkpoint
// once the `isCheckpointFn` test passes, the queue is flushed
getObjectsStream()
.on('error', function() {...})
.pipe(checkpoint.obj(function(obj) {
return typeof obj.token !== 'undefined'
}))
.on('checkpoint', function(obj) {
// the obj from `getObjectsStream()` that passed the `isCheckpointFn` test
})
.on('data', function(obj) {
// emitted for each object
})
Say you're working with a streaming API that returns many results. Anywhere during transmission, the API call could fail. The API knows this, so it periodically returns a token you can use when you retry the request.
When you get a result that has that token, that's kind of like a "checkpoint". It means, release all the results we've received up until now, because we know we'll be able to pick up from here when we go to retry the request.
TransformStream
(via through2
)TransformStream
(via through2
)Object
or Function
A configuration object. If a function is provided, it is treated as config.isCheckpointFn
.
Function
This function will receive each data event that is emitted from the source stream. Return a boolean to indicate if this is a checkpoint or not. If it is a checkpoint, this event, and any previously queued events before it will be passed through to the next stream in your pipeline. If it is not a checkpoint, this event will be queued until you return true
in a future data event.
Number
10
Configure how many results will be queued before they are released, regardless of if a checkpoint has been reached.
Boolean
false
Enable objectMode
when dealing with streams in object mode.
FAQs
Queue data from a stream until a checkpoint is hit
The npm package checkpoint-stream receives a total of 92,565 weekly downloads. As such, checkpoint-stream popularity was classified as popular.
We found that checkpoint-stream demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
Security News
As cyber threats become more autonomous, AI-powered defenses are crucial for businesses to stay ahead of attackers who can exploit software vulnerabilities at scale.
Security News
UnitedHealth Group disclosed that the ransomware attack on Change Healthcare compromised protected health information for millions in the U.S., with estimated costs to the company expected to reach $1 billion.