Security News
npm Updates Search Experience with New Objective Sorting Options
npm has a revamped search experience with new, more transparent sorting options—Relevance, Downloads, Dependents, and Publish Date.
db-streamer
Advanced tools
A library to stream data into a SQL database.
Project is in alpha version. Currently supports streaming data into PostgreSQL table.
var dbStreamer = require('db-streamer');
// create inserter
var inserter = dbStreamer.getInserter({
dbConnString: 'postgres://streamer:streamer@localhost:5432/streamer-test',
tableName: 'test_table',
columns: ['a', 'b', 'c']
});
// establish connection
inserter.connect(function(err, client) {
// push some rows
inserter.push({a: 1, b: 'one', c: new Date() });
inserter.push({a: 2, b: 'two', c: new Date() });
inserter.push({a: 3, b: 'three', c: new Date() });
// create child table inserter using deferring strategy
// this is useful to avoid missing foreign key conflicts as a result of race conditions
var childInserter = dbStreamer.getInserter({
tableName: 'child_table',
columns: ['a', 'd', 'e'],
client: client,
deferUntilEnd: true
});
childInserter.push({a: 2, d: 'asdf', e: new Date() });
childInserter.push({a: 3, d: 'ghjk', e: new Date() });
childInserter.setEndHandler(callback);
// set end callback
inserter.setEndHandler(function() {
childInserter.end();
});
// announce end
inserter.end();
});
Key | Description |
---|---|
dbConnString | A database connection string. |
tableName | The tablename to insert into. |
columns | Array of column names. |
client | Optional. A database client. Provide this in place of dbConnString. |
deferUntilEnd | Boolean (default=false). Stream output to temporary file which is then streamed in all at once into table upon calling end . |
Key | Description |
---|---|
useSequelizeBulkInsert | Boolean. Perform the insert using a combination of async.cargo and sequelize bulkInsert. Must provide sequelizeModel parameter too. |
sequelizeModel | The sequelize model to perform a bulk insert with. |
deferUntilEnd | Boolean (default=false). Pause all cargo iterations until calling end . |
In order to use this library, you must also install the following libraries:
npm install pg --save
npm install pg-copy-streams --save
npm install pg-hstore --save
FAQs
A library to stream data into a SQL database.
The npm package db-streamer receives a total of 1 weekly downloads. As such, db-streamer popularity was classified as not popular.
We found that db-streamer demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
npm has a revamped search experience with new, more transparent sorting options—Relevance, Downloads, Dependents, and Publish Date.
Security News
A supply chain attack has been detected in versions 1.95.6 and 1.95.7 of the popular @solana/web3.js library.
Research
Security News
A malicious npm package targets Solana developers, rerouting funds in 2% of transactions to a hardcoded address.