@wmfs/pg-telepods

pg-telepods

Takes the contents of one PostgreSQL table, applies a transformation function to each row and ensures a target table is kept in sync

Install

$ npm install pg-telepods --save

Usage

const pg = require('pg')
const startTelepods = require('pg-telepods')

// Make a new Postgres client
const client = new pg.Client('postgres://postgres:postgres@localhost:5432/my_test_db')
client.connect()

// Start the Telepods...

startTelepods(
  {
    client: client,
    outputDir: '/some/temp/dir',
    source: {  
      tableName: 'springfield.people',
      hashSumColumnName: 'hash_sum'
    },
    target: {
      tableName: 'government.census',
      hashSumColumnName: 'origin_hash_sum'
    },
    join: {
      'social_security_id': 'social_security_id' // key = source table column, value = target table column
    },
    transformFunction: function (sourceRow, callback) {
      callback(null, {
        'socialSecurityId': sourceRow.socialSecurityId,
        'name': sourceRow.firstName + ' ' + sourceRow.lastName,
        'town': 'Springfield'
      })
    }
  },
  function (err) {
    // All data synchronized from people -> census.
  }
)

Testing

Before running these tests, you'll need a test PostgreSQL database available and set a PG_CONNECTION_STRING environment variable to point to it, for example:

PG_CONNECTION_STRING=postgres://postgres:postgres@localhost:5432/my_test_db

$ npm test

License

MIT

Changelog

1.87.1 (2021-01-24)

🐛 Bug Fixes

• Be less picky about when to create the conflicts file (922f17c)

🛠 Builds

• deps-dev: Bump @wmfs/hl-pg-client from 1.26.0 to 1.27.0 (a0c5aa6)
• deps-dev: Bump semantic-release from 17.3.1 to 17.3.2 (ac78e2e)
• deps-dev: Bump semantic-release from 17.3.2 to 17.3.3 (6da6543)
• deps-dev: Bump semantic-release from 17.3.3 to 17.3.4 (16c31ab)
• deps-dev: Bump semantic-release from 17.3.4 to 17.3.5 (35404da)
• deps-dev: Bump semantic-release from 17.3.5 to 17.3.6 (e647202)
• deps-dev: Bump semantic-release from 17.3.6 to 17.3.7 (0ed3ed5)