Socket
Socket
Sign inDemoInstall

@gosquared/es-migrate

Package Overview
Dependencies
2
Maintainers
3
Versions
5
Alerts
File Explorer

Advanced tools

Install Socket

Detect and block malicious and high-risk dependencies

Install

    @gosquared/es-migrate

Tool to migrate documents from one cluster to another.


Version published
Maintainers
3
Created

Readme

Source

Tool to help set up and run elasticsearch migrations.

Install

npm i -g @gosquared/es-migrate

Usage

Create a new migration project:

es-migrate init es-migrate-1

Change to project directory. See readme for further instructions.

cd es-migrate-1
cat README.md

Rationale

We were finally upgrading our 2.3 cluster to 7.x. Due to breaking changes, some mappings needed to be changed and documents reindexed. It is easier to migrate direct from 2.x to 7.x than stepping through 5.x and 6.x, although not 'easy' to do either!

Breaking changes that affected us:

  • "_type" field deprecated / no longer supported.

The Elasticsearch Reindex API is useful but has limited transform options.

Since we work in Javascript we found it easiest to write our transforms in JS.

Why direct was preferable

If we were to upgrade via 5.x and 6.x, we would need to make our services compatible with each version. Also, each node in the cluster would need to be cycled, involving manual patching and restarting the node - a labour intensive process.

Ignore linting

git config blame.ignoreRevsFile .ignore-revs

https://www.elastic.co/guide/en/elasticsearch/client/javascript-api/current/installation.html#js-compatibility-matrix

https://opensearch.org/docs/clients/index/

Keywords

FAQs

Last updated on 04 Oct 2021

Did you know?

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc