couchdb-dump
Advanced tools
A command line tool that outputs all documents (including any attachments) in a CouchDB database. Also included is a command line tool that takes that output as input and loads it back into a CouchDB database.
Reading and writing the data is done via stdin and stdout, respectively. The output of cdbdump is a JSON document containing a "docs" array element which contains every document in the database. The cdbload command takes an input which is exactly the same as the output of cdbdump and writes every document in it into the target database.
Internally this is just calling on CouchDB's _all_docs and _bulk_docs endpoints. To do what it does, this package just glues together the power of Node.js streams and the following modules...
Many thanks to the authors of those amazing packages for making this possible.
npm install -g couchdb-dump
The following will dump the contents of a CouchDB database called myhugedatabase running on port 5984 on localhost. The output is written to a file called myhugedatabase.json.
cdbdump -d myhugedatabase > myhugedatabase.json
If you are doing this for archiving purposes you could do something cool like this to extract and gzip it in one step ...
cdbdump -d myhugedatabase | gzip > myhugedatabase.json.gz
Both of the following command examples will load all the documents in the myhugedatabase.json file into a CouchDB database called myhugeduplicate.
cdbload -d myhugeduplicate < myhugedatabase.json
OR
cat myhugedatabase.json | cdbload -d myhugeduplicate
You can even do this ...
cdbdump -d myhugedatabase | cdbload -d myhugeduplicate
... which streams all the docs from one CouchDB database into a second one. While this works well, you should probably take a look at using CouchDB's awesome built-in replication features instead.
cdbdump Full UsageIf you execute the cdbdump command with no arguments or with --help, the following usage information will be printed on the console and the command will exit.
usage: cdbdump [-u username] [-p password] [-h host] [-P port] [-r protocol] [-s json-stringify-space] [-k dont-strip-revs] [-D design doc] [-v view] -d database
The username and password, if supplied, will be used for authentication via Basic Auth (RFC2617). Currently this is the only supported authentication method.
If you want to constrain the documents exported to only those that belong to a CouchDB View, you can pass the -D and -v options to specify the design document and view function name respectively. This won't work with views that reduce or do other fancy things.
The -s parameter for cdbdump is used as the third parameter to JSON.stringify() for the amount of white space to use if you want the output to be pretty-printed.
By default, the _rev element of every document is stripped out of the output of cdbdump. This allows the list of documents to be used as input to cdbload. If the -k parameter is given to cdbdump, then the _rev elements will not be stripped out and this will cause CouchDB to be unable to easily load these documents through the _bulk_docs endpoint because every document will error with a mismatched revision message (assuming you are loading into an empty database). See CouchDB _bulk_docs documentation for more details and ways you can manipulate the cdbdump output to get around that in case you need to keep the _rev values in your dump.
host = localhost
port = 5984
protocol = http
json-stringify-space = 0
dont-strip-revs = false
cdbload Full UsageIf you execute the cdbload command with no arguments or with --help, the following usage information will be printed on the console and the command will exit.
usage: cdbload [-u username] [-p password] [-h host] [-P port] [-r protocol] [-v verbose] -d database
The -v parameter for cdbload will print CouchDB's response body to the console. That will be an array with one JSON result object for every object loaded in!!
host = localhost
port = 5984
protocol = http
verbose = false
I wrote this because I couldn't find a cli dump tool for CouchDB that allowed me to pipe output directly. Since then I also found these other excellent options which you should definitely check out as well:
I had to get this going quick and dirty at the moment so there are no automated tests in place yet.
Fork and PR. Thanks!!
FAQs
Tools to dump, modify, and load documents in CouchDB from the command line. (Same basic concept as mysqldump, but much more and for CouchDB)
We found that couchdb-dump demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
Security News
The Socket Research Team has discovered six new malicious npm packages linked to North Korea’s Lazarus Group, designed to steal credentials and deploy backdoors.
Security News
Socket CEO Feross Aboukhadijeh discusses the open web, open source security, and how Socket tackles software supply chain attacks on The Pair Program podcast.
Security News
Opengrep continues building momentum with the alpha release of its Playground tool, demonstrating the project's rapid evolution just two months after its initial launch.