Huge News!Announcing our $40M Series B led by Abstract Ventures.Learn More
Socket
Sign inDemoInstall
Socket

data2model

Package Overview
Dependencies
Maintainers
1
Versions
8
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

data2model

Saves XML and CSV data to a database - based on models

  • 0.0.6
  • Source
  • npm
  • Socket score

Version published
Weekly downloads
3
increased by50%
Maintainers
1
Weekly downloads
 
Created
Source

data2model

Saves XML and CSV data to a database - based on models

This packages aims on providing a high performance, fast and convenient way to save data obtained via XML or CSV files. It uses LOAD DATA LOCAL INFILE for CSV files and parses XML data according to your models. Everything is created for you.

Models are created by running npm run-script createModel. The model creator requires redis for convenience, but currently only saves your databases. Redis uses database 10 by default and for now only creates an entry called modelCreator_database.

Installation

npm i data2model --save

What it does

For the sake of this example, it creates this INSERT ... ON DUPLICATE KEY UPDATE query:

INSERT INTO exampleModel (`col1`,`col2`,`created_at`,`updated_at`) VALUES ('hello','test','2015-09-22T16:48:41.355Z','2015-09-22T16:48:41.355Z'),('hello','test2','2015-09-22T16:48:41.355Z','2015-09-22T16:48:41.355Z'),('hello','test3','2015-09-22T16:48:41.355Z','2015-09-22T16:48:41.355Z') ON DUPLICATE KEY UPDATE `col1`=VALUES(`col1`),`col2`=VALUES(`col2`),`updated_at`=VALUES(`updated_at`)

and executes the query, given the exampleModel found in the models directory.

Important

Very new package, so there might be some bugs and issues.

Feel free to contribute or to post any issues. Needs node.js version >= 4.0.0.

Usage

For now, run node with the --harmony_destructuring flag as it isn't finally implemented.
  1. Copy (or create a new one) the .env.example file to .env in your apps root dir and fill in your credentials. You don't need to specify a database here.
  2. Start redis and run npm run-script createModel, follow the instructions.
  3. Have a look at the generated file inside the /models directory, you can add valueOptions, defaultValues and whatsoever
  4. Once done, saving XML data is as simple as:

2

  'use strict';
  const _Parser = require('data2model');
  const XmlParser = _Parser.xml;
  const CsvParser = _Parser.csv;
  let parser = new XmlParser({database: 'databaseToUse'});
  parser.parseFile("./examples/example.xml", ['exampleModel']);

Saving CSV data is quite similar:

  let model = new CsvParser({
      model: 'model',
      file: 'file.csv',
      database: 'database'
  });
  model.parse();

The XML parser uses dotNotation to access the xml nodes. A convenient way to get the dot notation is this:

  parser.parseFile("./examples/example.xml", {toDotNotation:true})
      .then(val => console.log(val));

I'll add some examples and easier usage later, feel free to ask on stackoverflow.com or post your issues here.

Examples

Check out the example Model in /models and the example xml/js file in /examples folder.

FAQs

Package last updated on 22 Sep 2015

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

npm

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc