ndjson

ndjson

Streaming newline delimited json parser + serializer. Available as a JS API and a CLI.

Usage

const ndjson = require('ndjson')

ndjson.parse([opts])

Returns a transform stream that accepts newline delimited json buffers and emits objects of parsed data.

Example file:

{"foo": "bar"}
{"hello": "world"}

Parsing it:

fs.createReadStream('data.txt')
  .pipe(ndjson.parse())
  .on('data', function(obj) {
    // obj is a javascript object
  })

Options

• strict can be set to false to discard non-valid JSON messages
• All other options are passed through to the stream class.

ndjson.stringify([opts])

Returns a transform stream that accepts JSON objects and emits newline delimited json buffers.

example usage:

var serialize = ndjson.serialize()
serialize.on('data', function(line) {
  // line is a line of stringified JSON with a newline delimiter at the end
})
serialize.write({"foo": "bar"})
serialize.end()

Options

Options are passed through to the stream class.

LICENSE

BSD-3-Clause

Similar packages

Other packages similar to ndjson

JSONStream

JSONStream is a package for streaming JSON data in Node.js. It can parse and stringify JSON data, but it is more general-purpose compared to ndjson, which is specifically designed for NDJSON format. JSONStream can handle nested JSON structures and provides more flexibility in processing JSON data.

event-stream

event-stream is a collection of stream utility modules for Node.js. It includes functionalities for working with JSON data, such as parsing and stringifying. While it is not specifically designed for NDJSON, it can be used to achieve similar results with more general stream processing capabilities.

split2

split2 is a small utility for splitting streams of data. It can be used to split NDJSON data by newlines and then parse each line as JSON. While it is not as specialized as ndjson, it provides a lightweight alternative for handling NDJSON data.