Security News
ESLint is Now Language-Agnostic: Linting JSON, Markdown, and Beyond
ESLint has added JSON and Markdown linting support with new officially-supported plugins, expanding its versatility beyond JavaScript.
limited-request-queue
Advanced tools
Interactively manage concurrency for outbound requests.
Features:
// Will work with any similar module, not just "request"
var request = require("request");
var RequestQueue = require("limited-request-queue");
var queue = new RequestQueue(null, {
item: function(input, done) {
request(input.url, function(error, response) {
done();
});
},
end: function() {
console.log("Queue completed!");
}
});
var urls = ["http://website.com/dir1/", "http://website.com/dir2/"];
urls.forEach(queue.enqueue, queue);
setTimeout(queue.pause, 500);
setTimeout(queue.resume, 5000);
Node.js >= 4
is required. To install, type this at the command line:
npm install limited-request-queue
Note: for use in a web browser, you will likely need Object.assign
and URL
polyfills for maximum coverage.
new RequestQueue(options, handlers);
.dequeue(id)
Removes a queue item from the queue. Use of this function is likely not needed as items are auto-dequeued when their turn is reached. Returns true
on success or an Error
on failure.
.enqueue(input)
Adds a URL to the queue. input
can either be a URL String
or a configuration Object
. Returns a queue ID on success or an Error
on failure.
If input
is an Object
, it will accept the following keys:
url
: a URL String
, URL
or Node URL-compatible Object
.data
: additional data to be stored in the queue item.id
: a unique ID (String
or Number
). If not defined, one will be generated..length()
Returns the total number of items in the queue, active and inactive.
.numActive()
Returns the number of items whose requests are currently in progress.
.numQueued()
Returns the number of items that have not yet made requests.
.pause()
Pauses the queue, but will not pause any active requests.
.resume()
Resumes the queue.
options.ignorePorts
Type: Boolean
Default value: true
Whether or not to treat identical hosts of different ports as a single concurrent group. Example: when true
, http://mywebsite.com:80 and http://mywebsite.com:8080 may not have outgoing connections at the same time, but http://mywebsite.com:80 and http://yourwebsite.com:8080 will.
options.ignoreSchemes
Type: Boolean
Default value: true
Whether or not to treat identical hosts of different schemes/protocols as a single concurrent group. Example: when true
, http://mywebsite.com and https://mywebsite.com may not have outgoing connections at the same time, but http://mywebsite.com and https://yourwebsite.com will.
options.ignoreSubdomains
Type: Boolean
Default value: true
Whether or not to treat identical hosts of different subdomains as a single concurrent group. Example: when true
, http://mywebsite.com and http://www.mywebsite.com may not have outgoing connections at the same time, but http://mywebsite.com and http://www.yourwebsite.com will.
This option is not available in the browser version (due to extreme file size).
options.maxSockets
Type: Number
Default value: Infinity
The maximum number of connections allowed at any given time. A value of 0
will prevent anything from going out. A value of Infinity
will provide no concurrency limiting.
options.maxSocketsPerHost
Type: Number
Default value: 1
The maximum number of connections per host allowed at any given time. A value of 0
will prevent anything from going out. A value of Infinity
will provide no per-host concurrency limiting.
options.rateLimit
Type: Number
Default value: 0
The number of milliseconds to wait before each request. For a typical rate limiter, also set maxSockets
to 1
.
handlers.end
Called when the last item in the queue has been completed.
handlers.item
Called when a queue item's turn has been reached. Arguments are: input
, done
.
FAQs
Interactively manage concurrency for outbound requests.
The npm package limited-request-queue receives a total of 9,946 weekly downloads. As such, limited-request-queue popularity was classified as popular.
We found that limited-request-queue demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
ESLint has added JSON and Markdown linting support with new officially-supported plugins, expanding its versatility beyond JavaScript.
Security News
Members Hub is conducting large-scale campaigns to artificially boost Discord server metrics, undermining community trust and platform integrity.
Security News
NIST has failed to meet its self-imposed deadline of clearing the NVD's backlog by the end of the fiscal year. Meanwhile, CVE's awaiting analysis have increased by 33% since June.