fastparallel

What is fastparallel?

The fastparallel npm package is designed to handle parallel function execution efficiently. It allows you to run multiple asynchronous tasks in parallel and collect their results once all tasks are completed. This can be particularly useful for scenarios where you need to perform multiple I/O-bound operations concurrently.

What are fastparallel's main functionalities?

Parallel Execution

This feature allows you to execute multiple asynchronous tasks in parallel. The provided code sample demonstrates how to run two tasks concurrently and collect their results once both tasks are completed.

const fastparallel = require('fastparallel')();

function task1(arg, cb) {
  setTimeout(() => cb(null, 'result1'), 100);
}

function task2(arg, cb) {
  setTimeout(() => cb(null, 'result2'), 200);
}

fastparallel(null, [task1, task2], 'argument', (err, results) => {
  if (err) throw err;
  console.log(results); // ['result1', 'result2']
});

Error Handling

This feature demonstrates how fastparallel handles errors in parallel tasks. If any task encounters an error, the final callback receives the error, and the results array is not populated.

const fastparallel = require('fastparallel')();

function task1(arg, cb) {
  setTimeout(() => cb(null, 'result1'), 100);
}

function task2(arg, cb) {
  setTimeout(() => cb(new Error('Something went wrong'), null), 200);
}

fastparallel(null, [task1, task2], 'argument', (err, results) => {
  if (err) {
    console.error(err.message); // 'Something went wrong'
  } else {
    console.log(results);
  }
});

Other packages similar to fastparallel

async

The async package provides a wide range of utilities for working with asynchronous JavaScript. It includes methods for parallel execution, series execution, and more. Compared to fastparallel, async offers a broader set of functionalities but may be less performant for simple parallel execution tasks.

bluebird

Bluebird is a fully-featured Promise library that includes methods for managing multiple promises in parallel. It offers more advanced features like promise cancellation and long stack traces. While it is more feature-rich, it may be overkill for simple parallel execution scenarios that fastparallel handles efficiently.

p-map

p-map is a smaller utility that maps over promises concurrently. It allows you to control the concurrency level, making it more flexible for certain use cases. However, it is less specialized than fastparallel for simple parallel function execution.

README

fastparallel

Zero-overhead parallel function call for node.js. Also supports each and map!

Benchmark for doing 3 calls setImmediate 1 million times:

benchSetImmediate*1000000: 1378.514ms
benchAsyncParallel*1000000: 1740.304ms
benchAsyncEach*1000000: 1566.517ms
benchAsyncMap*1000000: 1687.518ms
benchNeoParallel*1000000: 1388.223ms
benchNeoEach*1000000: 1473.006ms
benchNeoMap*1000000: 1402.986ms
benchInsyncParallel*1000000: 1957.863ms
benchInsyncEach*1000000: 1383.822ms
benchInsyncMap*1000000: 1822.954ms
benchItemsParallel*1000000: 1690.118ms
benchParallelize*1000000: 1570.064ms
benchFastParallel*1000000: 1536.692ms
benchFastParallelNoResults*1000000: 1363.145ms
benchFastParallelEachResults*1000000: 1508.134ms
benchFastParallelEach*1000000: 1325.314ms

Obtained on node 12.18.2, on a dedicated server.

If you need zero-overhead series function call, check out fastseries. If you need a fast work queue check out fastq. If you need to run fast waterfall calls, use fastfall.

The major difference between version 1.x.x and 2.x.x is the order of results, this is now ready to replace async in every case.

Example for parallel call

var parallel = require('fastparallel')({
  // this is a function that will be called
  // when a parallel completes
  released: completed,

  // if you want the results, then here you are
  results: true
})

parallel(
  {}, // what will be this in the functions
  [something, something, something], // functions to call
  42, // the first argument of the functions
  done // the function to be called when the parallel ends
)

function something (arg, cb) {
  setImmediate(cb, null, 'myresult')
}

function done (err, results) {
  console.log('parallel completed, results:', results)
}

function completed () {
  console.log('parallel completed!')
}

Example for each and map calls

var parallel = require('fastparallel')({
  // this is a function that will be called
  // when a parallel completes
  released: completed,

  // if you want the results, then here you are
  // passing false disables map
  results: true
})

parallel(
  {}, // what will be this in the functions
  something, // functions to call
  [1, 2, 3], // the first argument of the functions
  done // the function to be called when the parallel ends
)

function something (arg, cb) {
  setImmediate(cb, null, 'myresult')
}

function done (err, results) {
  console.log('parallel completed, results:', results)
}

function completed () {
  console.log('parallel completed!')
}

Caveats

The done function will be called only once, even if more than one error happen.

This library works by caching the latest used function, so that running a new parallel does not cause any memory allocations.

Why it is so fast?

1. This library is caching functions a lot.

2. V8 optimizations: thanks to caching, the functions can be optimized by V8 (if they are optimizable, and I took great care of making them so).

3. Don't use arrays if you just need a queue. A linked list implemented via processes is much faster if you don't need to access elements in between.

4. Accept passing a this for the functions. Thanks to this hack, you can extract your functions, and place them in a outer level where they are not created at every execution.

License

ISC