@dictadata/storage-junctions 0.9.x
Storage Junctions is a Node.js library useful for creating apps that access distributed data sources, perform ETL transfers, prepare data for analytics and developing API services.
StorageJunction provides a normalized, plug-in interface to access disparate data sources such as data files, database tables, document collections, key/value stores, etc. with one standardized interface.
Installation
npm install @dictadata/storage-junctions
Getting Started
Documentation
Storage Junctions contains documentation for dictadata Storage Junctions base types, classes, standard junctions and file systems needed to use the library.
Supported Storage Sources many junctions are available for popular data sources such as CSV, JSON, Excel, PDF, REST API, Geo Shape files, MySQL, Microsoft SQL Server, ElasticSearch, Oracle DB, Amazon Redshift. Any data source can be support via a plugin.
Supported File Systems many file systems are available such as FTP, HTTP, Amazon S3, ZIP and local files. Any file based source can be support via a plugin.
Usage and example
Related Projects
Storage-ETL is command line interface (CLI) for using Storage Junctions library to transfer data between data sources, perform data transformations and manage data schemas. Features Engrams
a data dictionary service to manage data sources and schemas amongst users and applications.
Storage-Node is a Node.js with Express.js based HTTP server application with extensible API services. A plugin framework supports all the base junctions and file systems from Storage Junctions library and custom plugins.
Storage Plugins List of the various storage junctions and file system plugins that can be used with Storage-ETL and Storage-Node.