Deepmerge Json
What
A simple library to deep merge json files with array operations. Hugely inspired by the awesome deepmerge project.
Note that you can use to merge javascript objects, but the main reason this library was created was to merge json files with optional special operations for array merging.
Why
Sometimes you need a deeply copied objects. Sometimes you need to alter these objects to make them more extensible and generic, specially when you are using convention over configuration or convention over code patterns.
The objective of this library is to help you with these situations being really simple, performatic and small (~1.5kb).
How
let left = {
keep: 'keep',
simple: 10,
obj: { a: { multi: { level: 'property' } }, is: 'ok' },
merge: [0, 1, 2, 3],
append: [0, 1, 2],
prepend: [0, 1, 2]
};
let right = {
simple: 20,
obj: { a: { multi: { level: 'and' }, deep: 'property' } },
merge: [10, 20],
append: { $append: [3, 4, 5] },
prepend: { $prepend: [-2, -1] }
};
let result = merge(left, right);
console.log(result);
{
keep: 'keep',
simple: 20,
obj: { a: { multi: { level: 'and' }, deep: 'property' }, is: 'ok' },
merge: [10, 20, 2, 3],
append: [0, 1, 2, 3, 4, 5],
prepend: [-2, -1, 0, 1, 2]
}
Explanation: it deeply merges right
object into left
without altering them and their properties. Everything is cloned. Arrays elements are merged based on right
parameters (operators) passed as objects.
Installation
With NPM
npm install deepmerge-json
After that you can import it:
import merge from 'deepmerge-json';
or
const merge = require('deepmerge-json');
There is even a Typescript d.ts
definition file to support auto complete.
With a CDN
Just add this line to your HTML file:
<script src="https://unpkg.com/deepmerge-json@latest/dist/deepmerge-json.min.js></script>
Usage
The main reason this library was created was to mimic and extend some array merging functions from mongodb when merging two sets of properties json files.
Simple Merge
It is possible to merge recursively all types of properties.
const left = {
boolValue: false,
numberValue: 100,
stringValue: 'target',
objectValue: {
foo: 0,
bar: 'bar',
baz: {
baz1: 1,
baz2: 2
}
}
};
const right = {
boolValue: true,
numberValue: 222,
stringValue: 'source',
objectValue: {
foo: 'foo',
baz: {
baz3: 3
}
}
};
const res = merge(left, right);
{
boolValue: true,
numberValue: 222,
stringValue: 'source',
objectValue: {
foo: 'foo',
bar: 'bar',
baz: {
baz1: 1,
baz2: 2,
baz3: 3
}
}
}
Clone
You can clone an object omitting the second parameter. This will execute the merge
function with an empty second parameter, which results in a deep clone of the first one.
Notice that if you pass anything other than undefined
to the second parameter (even null
), it will be actively used in the merge process.
You can also use the merge.clone()
method which is an alias to the merge
method with a single parameter. It's also more semantically meaningful.
Array Merge
Merging arrays are special because sometimes you want to append elements, sometimes prepend and sometimes you want to merge them.
Mongodb handles this nicely (IMHO). It has a $push
property (among others) that let you append elements to an array when updating a document.
Inspired on that, this library has some merging methods (here called operations) to help you merge or improve the arrays from the original object. Just keep in mind that no matter the depth of the array, you just need to have the same path to the objects you want to merge.
Merging Elements
This is the default behavior. It merges the arrays elements one by one. It will add elements to the end if there more on the right than on the left element.
const left = {
foo: [1, 2, 3],
bar: []
};
const right = {
foo: [10, 20],
bar: [10, 20, 30]
};
const result = merge(left, right)
{
foo: [10, 20, 3],
bar: [10, 20, 30]
}
$push / $append
You can use the $push
or $append
operation to add elements to the end of the "left" array.
const left = [0, 1, 2];
const right = { $push: [3, 4, 5] };
const result = merge(left, right);
[0, 1, 2, 3, 4, 5];
$prepend
Similarly, you can use $prepend
operation to add elements to the beginning of the "left" array.
const left = [0, 1, 2];
const right = { $prepend: [-2, -1] };
const result = merge(left, right);
[-2, -1, 0, 1, 2];
$set
Use $set
when you want to completely replace "left" array by the "right" one.
const left = [0, 1, 2, 3, 4, 5, 6];
const right = { $set: [10, 20] };
const result = merge(left, right);
[10, 20];
$replace
Use $replace
to replace or add indexed elements by their indexes. Indexes can be numbers or strings and cannot be less than 0 or NaN
values.
With valid indexes:
const left = [10, 20, 30];
const right = { $replace: { 0: 100, 2: 300, 4: 400 } };
const result = merge(left, right);
[100, 20, 300, , 400];
With invalid indexes:
const left = [10, 20, 30];
const right = { $replace: { null: 0, foo: 0, true: 0, '-1': 0 } };
const result = merge(left, right);
With objects
[1.4.0]
It completely replaces the indicated left element with the corresponding right element.
Note for users of version < 1.4.0
: if you want the old operation functionality, replace $replace
for $merge
.
const left = [{ a: 1, b: 1 }, { c: 1 }];
const right = { $merge: [{ a: 2 }] };
const result = merge(left, right);
[{ a: 2 }, { c: 1 }];
$merge
Use $merge
to merge or add indexed elements by their indexes. Indexes can be numbers or strings and cannot be less than 0 or NaN
values. It's similar to $replace
but instead of replacing the values when found, it merges them with the new values.
With valid indexes:
const left = [10, 20, 30];
const right = { $merge: { 0: 100, 2: 300, 4: 400 } };
const result = merge(left, right);
[100, 20, 300, , 400];
With invalid indexes:
const left = [10, 20, 30];
const right = { $merge: { null: 0, foo: 0, true: 0, '-1': 0 } };
const result = merge(left, right);
With objects
const left = [{ a: 1, b: 1 }, { c: 1 }];
const right = { $merge: [{ a: 2 }] };
const result = merge(left, right);
[{ a: 2, b: 1 }, { c: 1 }];
$insert
Use $insert
to insert indexed elements at their indexes. Indexes can be numbers or strings and cannot NaN
values. Notice that elements change places as you insert them. Negative numbers insert them to the end of the array. See Array.splice.
With positive indexes:
const left = [10, 20, 30];
const right = { $insert: { 0: 100, 2: 200, 10: 400 } };
const result = merge(left, right);
[100, 10, 200, 20, 30, 400];
With negative indexes:
const left = [10, 20, 30];
const right = { $insert: { '-1': 100, '-2': 200, '-10': 0 } };
const result = merge(left, right);
[0, 10, 20, 200, 100, 30];
With invalid indexes:
const left = [10, 20, 30];
const right = { $insert: { null: 100, foo: 300, true: 400 } };
const result = merge(left, right);
Skipping Elements
If you skip some elements in the "right" array, the respective "left" elements will be kept in the result. This is not very useful for json merging since it's ot possible to create a sparse array per se, but it's a nice consequence of the merge
method.
const left = [1, 20, 3, 40, 5, 60];
const right = [10, , 30, , 50];
const result = merge(left, right);
[10, 20, 30, 40, 50, 60];
Multiple Operations
Starting from version 1.3.0
it's possible to use multiple operations at once. They are executed in place and in order.
const left = [2, 3, 4];
const right: {
$prepend: [0, 1],
$append: [5, 6],
$replace: { 0: 100 };
}
const result = merge(left, right);
[100, 1, 2, 3, 4, 5, 6]
const left = [2, 3, 4];
const right: {
$replace: { 0: 100 };
$prepend: [0, 1],
$append: [5, 6],
}
const result = merge(left, right);
[0, 1, 100, 3, 4, 5, 6]
Merging Multiple Objects
You can also merge multiple objects with the help of the utility method merge.multi()
. It respects the order of the parameters and the operations just like expected if you call merge
multiple times passing the last result as the first parameter to the next call.
const obj1 = { a: 0, b: [true, { c: 'ok' }] };
const obj2 = { a: 10, d: false };
const obj3 = { a: 20, b: { $push: [42] } };
const result = merge.multi(obj1, obj2, obj3);
{ a: 20, b: [true, { c: 'ok' }, 42], d: false }
Options
For now, no options yet :chipmunk:.
Contributing
If you are nice enough you can submit bugs and features to the issue board and make this lib great and useful for you and the community.
But if you are really nice you can submit a PR and make this lib awesome!
Rough Performance Test
Just a fun performance test with a 1 million runs. I'm not a performance expert so they might not be very precise.
Testing machine:
- CPU: Intel Core i5-9300H @ 2.4GHz x8
- Memory: 32GB
- SO: Ubuntu 20.04.4 LTS
Measures | Node 17.7.2 | Chrome 100.0.4896.75 | Firefox 99.0 2 :thinking: |
---|
Max. Value | 279,763.93 | 295,386.07 | 852,514.92 |
Min. Value | 277,344.35 | 287,802.91 | 827,814.57 |
Average1 | 279,574.05 | 293,929.66 | 840,884.13 |
- Operations per second
- 1 The average is calculated removing the maximum and the minimum values
- 2 For some reason Firefox returned a really good but suspicious performance