stream-compare

stream-compare

Compare the output of two Readable streams using a caller-provided comparison/assertion function.

Introductory Example

var assert = require('assert');
var fs = require('fs');
var streamCompare = require('stream-compare');

var stream1 = fs.createReadStream(file);
var stream2 = fs.createReadStream(file);
streamCompare(stream1, stream2, assert.deepStrictEqual).catch(function(err) {
  console.log(err); // AssertionError if streams differ
});

Features

This package is similar to the stream-equal package with several additional features:

• Support for caller-defined comparisons, which can return errors or values not limited to equality.
• Support for both incremental and one-shot comparisons.
• Support for caller-defined data reduction to avoid storing the entire stream history in memory before comparison.
• Makes no assumptions about the type of values read beyond whether they should be treated as objects (objectMode) or a stream of Buffers or strings.
• Does not do any coercion of the values read.
• Support for comparing (caller-configurable) events emitted by the streams.
• Support reading in flowing or non-flowing mode.
• Support for optionally aborting comparison on stream errors.
• Support for catching multiple end/error events (within one tick by default, or an optional configurable delay).
• Utility function for creating an incremental comparison and data-reduction function from a standard data comparison function (e.g. assert.deepEqual).

Installation

This package can be installed using npm, either globally or locally, by running:

npm install stream-compare

Recipes

Compare Incrementally

In order to avoid unnecessary memory use for streams with large amounts of data and avoid unnecessary delays for streams which produce data slowly, the output can be compared incrementally and inconclusive output can be removed. This is done by the incremental function. To make this easier, the utility function makeIncremental creates such a function from a data comparison function and/or an events comparison function:

var options = {
  incremental: streamCompare.makeIncremental(
    assert.deepStrictEqual,     // Compares data
    assert.deepStrictEqual      // Compares events
  )
};
streamCompare(stream1, stream2, options).catch(function(err) {
  console.log(err); // AssertionError if stream data values differ
});

Compare Data Values Separately

Sometimes it may be desirable to compare the values returned by .read() or 'data' events separately, rather than concatenated together. This can be done by setting objectMode: true (even if the values aren't Objects):

var options = {
  compare: assert.deepStrictEqual,
  objectMode: true
};
streamCompare(stream1, stream2, options).catch(function(err) {
  console.log(err); // AssertionError if stream data values differ
});

Compare Data and Event Interleaving

In order to compare the ordering of 'data' events with other events, add 'data' to the events option and set readPolicy to 'flowing' or 'none'. Any 'data' events and their arguments will appear with any other matching events in the events property of the state object.

var options = {
  compare: assert.deepStrictEqual,
  events: ['close', 'data', 'end', 'error'],
  readPolicy: 'none'
};
streamCompare(stream1, stream2, options).catch(function(err) {
  console.log(err); // AssertionError if stream events (including 'data') differ
});

Control comparison checkpoints

The returned Promise includes additional methods for controlling the comparison. A non-incremental compare can be run before both streams end using .checkpoint(). Additionally, the comparison can be concluded before both streams end using .end(). The full details are available in the API Documentation.

var PassThrough = require('stream').PassThrough;

var stream1 = new PassThrough();
var stream2 = new PassThrough();
var comparison = streamCompare(stream1, stream2, assert.deepStrictEqual);
comparison.then(
  function() { console.log('streams are equal'); },
  function(err) { console.log('streams differ: ' + err); }
);
stream1.write('Hello');
stream2.write('Hello');
process.nextTick(function() {
  comparison.checkpoint();

  stream1.write(' world!');
  stream2.write(' world!');

  process.nextTick(function() {
    comparison.end();
  });
});

More examples can be found in the test specifications.

API Docs

For the details of using this module as a library, see the API Documentation.

Contributing

Contributions are welcome and very much appreciated! Please add tests to cover any changes and ensure npm test passes.

If the desired change is large, complex, backwards-incompatible, can have significantly differing implementations, or may not be in scope for this project, opening an issue before writing the code can avoid frustration and save a lot of time and effort.

License

This package is available under the terms of the MIT License.

Changelog

v2.0.0 (2018-06-29)

Full Changelog

• BREAKING Drop support for Node < 6.
• Drop unnecessary dependencies.
• Dependency version updates.
• Code style improvements.