This is the Snowflake connector for ETLBox. It supports cloud-based data warehousing and analytics, letting you process large datasets in Snowflake. ETLBox is a complete ETL (Extract, Transform, Load) library and data integration toolbox for .NET. # Build scalable, code-first ETL pipelines for SQL, NoSQL, APIs, and flat files. # Automate data movement, transformation, and synchronization with minimal memory usage. # Ideal for data warehousing, migrations, and big data processing. Simplify your data integration workflow: ETLBox enables efficient, asynchronous data processing by reading from databases, APIs, and file formats like CSV, Excel, and JSON. Transform data dynamically with row-based, batch, or lookup transformations, and read or write from/to multiple destinations in parallel. Key Features: * Stream large datasets efficiently without loading everything into memory * Maximize performance with parallel, task-based data flow execution * Connect to various data sources with built-in connectors or extend with custom components For tutorials, examples, and documentation, visit: https://www.etlbox.net/
This is the CosmosDB connector for ETLBox. It provides integration with Azure Cosmos DB, enabling you to handle NoSQL data efficiently for scalable and distributed applications. ETLBox is a complete ETL (Extract, Transform, Load) library and data integration toolbox for .NET. # Build scalable, code-first ETL pipelines for SQL, NoSQL, APIs, and flat files. # Automate data movement, transformation, and synchronization with minimal memory usage. # Ideal for data warehousing, migrations, and big data processing. Simplify your data integration workflow: ETLBox enables efficient, asynchronous data processing by reading from databases, APIs, and file formats like CSV, Excel, and JSON. Transform data dynamically with row-based, batch, or lookup transformations, and read or write from/to multiple destinations in parallel. Key Features: * Stream large datasets efficiently without loading everything into memory * Maximize performance with parallel, task-based data flow execution * Connect to various data sources with built-in connectors or extend with custom components For tutorials, examples, and documentation, visit: https://www.etlbox.net/
This is the Neo4j connector for ETLBox. It supports graph database integration, enabling you to process and analyze connected data. ETLBox is a complete ETL (Extract, Transform, Load) library and data integration toolbox for .NET. # Build scalable, code-first ETL pipelines for SQL, NoSQL, APIs, and flat files. # Automate data movement, transformation, and synchronization with minimal memory usage. # Ideal for data warehousing, migrations, and big data processing. Simplify your data integration workflow: ETLBox enables efficient, asynchronous data processing by reading from databases, APIs, and file formats like CSV, Excel, and JSON. Transform data dynamically with row-based, batch, or lookup transformations, and read or write from/to multiple destinations in parallel. Key Features: * Stream large datasets efficiently without loading everything into memory * Maximize performance with parallel, task-based data flow execution * Connect to various data sources with built-in connectors or extend with custom components For tutorials, examples, and documentation, visit: https://www.etlbox.net/
This is the Tables connector for ETLBox. It supports working with Azure Table Storage, enabling structured data storage and retrieval for cloud-based applications. ETLBox is a complete ETL (Extract, Transform, Load) library and data integration toolbox for .NET. # Build scalable, code-first ETL pipelines for SQL, NoSQL, APIs, and flat files. # Automate data movement, transformation, and synchronization with minimal memory usage. # Ideal for data warehousing, migrations, and big data processing. Simplify your data integration workflow: ETLBox enables efficient, asynchronous data processing by reading from databases, APIs, and file formats like CSV, Excel, and JSON. Transform data dynamically with row-based, batch, or lookup transformations, and read or write from/to multiple destinations in parallel. Key Features: * Stream large datasets efficiently without loading everything into memory * Maximize performance with parallel, task-based data flow execution * Connect to various data sources with built-in connectors or extend with custom components For tutorials, examples, and documentation, visit: https://www.etlbox.net/
This is the DataFrame connector for ETLBox. It extends ETLBox with support for processing and transforming data using DataFrames, enabling efficient handling of structured data. ETLBox is a complete ETL (Extract, Transform, Load) library and data integration toolbox for .NET. # Build scalable, code-first ETL pipelines for SQL, NoSQL, APIs, and flat files. # Automate data movement, transformation, and synchronization with minimal memory usage. # Ideal for data warehousing, migrations, and big data processing. Simplify your data integration workflow: ETLBox enables efficient, asynchronous data processing by reading from databases, APIs, and file formats like CSV, Excel, and JSON. Transform data dynamically with row-based, batch, or lookup transformations, and read or write from/to multiple destinations in parallel. Key Features: * Stream large datasets efficiently without loading everything into memory * Maximize performance with parallel, task-based data flow execution * Connect to various data sources with built-in connectors or extend with custom components For tutorials, examples, and documentation, visit: https://www.etlbox.net/
This is the Apache Kafka connector for ETLBox. It allows you to work with Kafka topics, enabling event-driven architectures. ETLBox is a complete ETL (Extract, Transform, Load) library and data integration toolbox for .NET. # Build scalable, code-first ETL pipelines for SQL, NoSQL, APIs, and flat files. # Automate data movement, transformation, and synchronization with minimal memory usage. # Ideal for data warehousing, migrations, and big data processing. Simplify your data integration workflow: ETLBox enables efficient, asynchronous data processing by reading from databases, APIs, and file formats like CSV, Excel, and JSON. Transform data dynamically with row-based, batch, or lookup transformations, and read or write from/to multiple destinations in parallel. Key Features: * Stream large datasets efficiently without loading everything into memory * Maximize performance with parallel, task-based data flow execution * Connect to various data sources with built-in connectors or extend with custom components For tutorials, examples, and documentation, visit: https://www.etlbox.net/
An out-of-the-box Web API for invoking database stored procedures, transforming the results as JSON, BSON, JSONP, XML, CSV, Excel xlsx, or any text generated by Razor dynamic template. Please visit https://github.com/DataBooster/DbWebApi for detail.
A C# Server side component for the popuplar jQuery datatables plugin http://datatables.net/ suitable for asp.net core and other netstandard frameworks
An out-of-the-box Web API for invoking database stored procedures, transforming the results as JSON, BSON, JSONP, XML, CSV, Excel xlsx, or any text generated by Razor dynamic template. Please visit https://github.com/DataBooster/DbWebApi for detail.
MongoDB data provider for Stimulsoft products. MongoDB is a source-available cross-platform document-oriented database. Classified as a NoSQL database, MongoDB uses JSON-like documents with optional schemas.
An out-of-the-box Web API for invoking database stored procedures, transforming the results as JSON, BSON, JSONP, XML, CSV, Excel xlsx, or any text generated by Razor dynamic template. Please visit https://github.com/DataBooster/DbWebApi for detail.
Dapper ORM extension that maps string[] and object properties to JSON columns in Database.
An out-of-the-box Web API for invoking database stored procedures, transforming the results as JSON, BSON, JSONP, XML, CSV, Excel xlsx, or any text generated by Razor dynamic template. Please visit https://github.com/DataBooster/DbWebApi for detail.
Quartz.NET Json.NET serialization - the job store serializer for a database already holding Newtonsoft.Json's output. New applications use the System.Text.Json one built into Quartz; Quartz Scheduling Framework for .NET
Attribute based Field level encryption library for the .NET Couchbase SDK. Encrypted fields are protected in transit and at rest. Fields are transparently decrypted when they are retrieved from Couchbase within the application.
Aspose.OMR for C++ adds optical mark recognition (OMR) functionality to your applications. With it, you can design, render and recognize all types of hand-filled forms: answer sheets, examination papers, surveys, questionnaires, ballots, applications, and many more. No specialized equipment, consumables and third-party software required. Use your office copier or even a smartphone camera instead of an expensive OMR scanner. Respondents can fill out your forms with a pen, pencil or marker and use any type of marks - artificial intelligence and advanced accuracy calibration ensure reliable results. You can even recognize rotated and skewed images. Aspose.OMR for C++ can recognize any file you get from a scanner or camera: JPEG, PNG, TIFF, GIF, and BMP. Recognition results are returned in the most popular data storage formats (JSON and CSV) that can be imported into any popular database, CRM or analysis system. Aspose.OMR for C++ supports QR codes and barcodes recognition. Aspose.OMR for C++ offers a flexible markup language for designing OMR forms of any layout and complexity; you can even add QR codes, barcodes and images without using third-party libraries. All popular paper sizes as well as a number of non-standard ones are supported. Forms are saved in multiple file formats, intelligently selected based on the provided extension: JPEG, PNG, TIFF, GIF, and BMP. Changelog: - The library now works correctly in debug mode. - Resolved licensing module errors. - Improved JSON serialization/deserialization. - Minor improvements and fixes. Resources: Online documentation: https://docs.aspose.com/omr/cpp/ Free support forum: https://forum.aspose.com/c/omr/
Provide an ORM (Object-relational Mapper) and a database Hub targeting NoSQL and key-value databases. Hub API's: REST/OpenAPI, GraphQL, Batch (HTTP & WebSocket). The Hub support container relations, CRUD, query, messaging, Pub-Sub (changes & messages) and a admin page (Hub Explorer)
Oooops!Simple, simple-to-call approach, integration of multiple platforms, multiple environments!简单的、傻瓜式的调用方式,集成多平台、多环境!: This is an ASP.NET help class written in C#,which organized a lot of open source code,a lot of good authors and source code are referenced. The original purpose is to collect the various problems that have been encountered in development, and organize them into knowledge base, which can facilitate the development and learning of the future. The main functions of this help library are: File processing, log system, form transition, JSON, XML, parse, circuit breakers, retry mechanism, ZIP compression/decompression, Winform beautification, multi-thread calls, add and delete registry, mainstream database to add and delete, thread the fuse/kill, batch command/command-line execution, HTTP, string formatting, sentenced to services and service request Break, MD5, AES, DES, RSA, BASE64 and other encryption algorithms and other practical functions. The class library supports multiple versions (.net Framework 4.5~4.8/.NET5.0~6.0/.NET Core 3.1/.NET Standard2.0~2.1). To prevent code abuse, the library has its own signature verification mechanism, and the code needs to run on the signed machine.Future will continue to fill in various useful help library. The signing machine download please email:1924038917jsa@gmail.com or attention:https://github.com/GHjiaoshouang. If there is infringement please contact me. Thanks. `简单的、傻瓜式的调用方式,集成多平台、多环境! `这是基于C#语言开发的ASP.NET帮助库,里面整理了很多开源的代码,借鉴了很多优秀作者的代码。最初目的是用于搜集自己在开发当中遇到的各种问题,整理成知识库,便于以后的开发和学习。主要的功能有:文件处理、日志系统、表格转换、JSON解析、XML解析、断路机制、重试机制、ZIP压缩/解压缩、Winform美化、多线程调用、注册表增删改查、主流数据库增删改查、线程熔断/强杀、批命令/命令行执行、HTTP服务及服务请求、字符串格式化、判断、MD5/AES/DES/RSA/BASE64等多种加密算法等多种实用功能。类库支持多个版本(.NET Framework 4.5~4.8/.NET5.0~6.0/.NET Core 3.1/.NET Standard2.0~2.1)。 `如果使用过程中遇到问题,可以在【https://github.com/GHjiaoshouang/JSAHelpTest.git】查看具体的调用和使用方式。 `为了防止代码滥用,类库设有专属的签名验证机制,代码运行需要在已被签名的机器上。后期会不断向里面填充各类实用帮助类库。签名器关注GitHub:[https://github.com/GHjiaoshouang]。如有侵权请联系我。 `谢谢。
Firebase data provider for Stimulsoft products. The Firebase Realtime Database is a cloud-hosted database. Data is stored as JSON and synchronized in real time to every connected client.
Database-agnostic document store with JSON querying for .NET, with built-in dependency-injection registration and OpenTelemetry instrumentation.
Writer / Reader for dotnet objects in and out of a redis database
DbWebApi .Net Client Library. https://github.com/DataBooster/DbWebApi
A client library for accessing FileMaker databases using the FileMaker Data API (RESTful API) in FileMaker Server.
Goodbye WordPress is a customizable library and command line tool for exporting posts from a WordPress MySQL database to static Markdown or HTML files, with YAML front-matter for metadata preservation. It is intended as a starting point for migrating away from a WordPress blog to a static site. It further supports saving images referenced in the original posts and can generate a single-file archive of all exported posts in JSON format, in case the export process needs to run again after the MySQL database has been taken down. Note, there is a .NET 6.0 library ("Goodbye.WordPress") that can be integrated easily into a new .NET console application that allows heavy customization through overriding pieces of the export pipeline in WordPressExporterDelegate.
Mini-Biggy is a Very Fast Document/Relational Query Tool with Full LINQ Compliance.
eeCLOUD is a high-performance data engine for .NET 8 built around a logical Memory model instead of a traditional ORM schema. It combines high-throughput Raw JSON persistence with batched Object Graph storage for nested models, automatic database and memory bootstrap, clustering, reference indexing, date-range queries, mixed Raw JSON/V4 compatibility, SFTP binary storage, and optional eeCACHE acceleration across PostgreSQL, MySQL, SQL Server, SFTP and local cache backends. Optional per-instance telemetry exposes standard .NET metrics and traces compatible with OpenTelemetry, independently of the storage backend. It is designed for backend systems that need flexible data structures, rapid delivery and strong runtime performance without heavy ORM configuration.
调用方法: using Microsoft.AspNetCore.Builder; using Microsoft.AspNetCore.Hosting; using Microsoft.Extensions.Configuration; using Microsoft.Extensions.DependencyInjection; using Microsoft.Extensions.Hosting; using System.IO; public static IHostBuilder CreateHostBuilder(string[] args) { return Host.CreateDefaultBuilder(args).ConfigureWebHostDefaults(webBuilder => { webBuilder .UseConfiguration( new ConfigurationBuilder() .SetBasePath(Directory.GetCurrentDirectory()) //端口修改办法 // 1 appSetting.json 末尾加一行 "urls": "https://*:10086" 端口自己写 // 2 通过命令行 --urls=http://*:10086 .AddCommandLine(args) .Build()) //启用http1 和 http2 .EnableHttp1AndHttp2() //以下两段代码可以放到项目的Startup.cs中,本处方便说明 //组件(服务)时刻 .ConfigureServices((serviceProvider) => { //加入Mvc组件 serviceProvider.AddControllers(); //加入Symbol Cloud Server 组件 serviceProvider.AddSymbolCloudServer(); }) //启用时刻 .Configure((context, app) => { //启用调试页面 if (context.HostingEnvironment.IsDevelopment()) { app.UseDeveloperExceptionPage(); } //启用路由,Mvc必须使用 app.UseRouting(); //启用Symbol Cloud Server app.UseSymbolCloudServer(); //启用Symbol Cloud Server API列表页面 // true 表示 监听 / 并跳转到 /apiList.do app.UseSymbolCloudApiList(true); //endpoint映射 app.UseEndpoints(endpoints => { //首页,如果ApiList为false就可以打开它 //endpoints.MapGet("/", async context => { // await context.Response.WriteAsync("Hello World!"); //}); //Mvc路由规则 endpoints.MapControllerRoute(name: "default", pattern: "{controller}/{action}/{id?}"); }); }); }); } 请在最终运行的项目中配置服务端参数,文件名规则为:app_data/*.cloud.server.config.json,以下为参考配置: { //协议配置,可以是单个对象,或数组 //可以不填写 "protocol": [{ "name": "default",//名称,可选 "data": {//数据,不填写默认为json "type": "json", //类型:json,xml,treePackage,soap,custom "customType": null //可选,自定义格式类型:TestAssembly.TestClass, TestAssembly }, "encrypt": {//加密,不填写默认不加密 "type": "none",//类型:none,AESStatic,custom "customType": null //可选,自定义格式类型:TestAssembly.TestClass, TestAssembly }, "media": {//传输介质,不填写默认为original "type": "original",//类型:original,base64,hex,custom "customType": null //可选,自定义格式类型:TestAssembly.TestClass, TestAssembly } }], //服务器 "server": { "name": "my.cloud",//名称,可选 "host": "localhost",//主机:域名或IP,默认localhost "port": 1,//端口 "timeout": 120,//超时:秒,默认120,可选 "debug": true,//调试模式:默认不启用,可选 "settings": { } //参数设置:可选 }, //数据库,不需要可以不写 "database": { //连接参数 //通用参数:主机、端口、数据库名称、账号、密码 //其它参数可以写在里面,取决于提供者是否支持 "connection": { "host": "localhost", //主机,可以包括端口,经test.com:1433 "port":11433, //可以不写,表示默认 "name": "test", //数据库名称 "account": "test", //登录账号 "password": "123456" //登录密码 } }, //客户端 "client": [ { "name": "my.manager",//名称,可选,并没有影响 "enable": true,//状态 "authCode": "203AFBA5816078A7BAF822C04687B3D3",//授权码 "permissions": [ //权限列表,可选 ], //外部配置,可以不写 //可以为单个字符串,或数组 //外部配置可重写 authCode //外部配置可追加(自动去重) permissions //路径相对于配置文件 //支持变量 {name} {server.name} "config": [ "module.*.manager.client.json", "{server.name}.manager.client.json" ] } ] } 请在api项目中配置权限信息,命名规则以服务端配置config规则定义为准,以下为示例配置: 文件名:module.setting.manager.client.json 存储位置:app_data { "permissions": [ //系统设置.Begin "my.read.setting", "my.write.setting" //系统设置.End ] }
A custom ASP.NET Core Middleware plugin for distributed session state using Couchbase server as the backing store. Supports both Memcached (in-memory) and Couchbase (persistent) buckets.
Fluent Wrapper for DbCommand with JSON export support for query results
Provides operations such as saving files, fetching, validating and using json files as database in the file system.
Hub Explorer - Admin page for a Fliox Hub to browse hosted databases
JWTs is a simple library for generating and validating JWT tokens and Refresh Tokens. Refresh Tokens are dependent on a database / memory cache and an interface for a simple DAL for storing refresh tokens is included. JWTs can be generated with custom claims, and a DAL is only required when issuing Refresh Tokens. This library is independent of any overarching entities such as Application User and Client. This library is used in OAuthServer.NET.
jaindb base library to generate blockchain. Additional Storage-Providers are required
A C# Server side component for the popuplar jQuery datatables plugin http://datatables.net/
A generic implementation of MongoDB, a cross-platform document-oriented database program. Classified as a NoSQL database program, MongoDB uses JSON-like documents with optional schemas....
This client library enables working with RavenDB Cloud API. For reference see: - RavenDB Cloud : https://cloud.ravendb.net - RavenDB Cloud Swagger UI : https://api.cloud.ravendb.net/swagger/index.html - RavenDB Cloud Swagger JSON : https://api.cloud.ravendb.net/api/v1/swagger.json
Teaq is a mini-ORM that offers object materialization, relational mapping and query batching services. Teaq offers a simple API to do common database interactions with SQL Server. Performance is most important, as is low startup cost. In addition, queries can be arbitrarily batched to minimize server round trips for any scenario.
NFX.Web Package NFX UNISTACK includes: Application Container + Dependency Injection facilities Configuration engine BigMemory: Local/Distributed piles/heaps, ability to store hundreds of millions of objects resident in memory for long times without killing GC BigMemory Cache - store hudreds of millions of objects in RAM without GC pressure (full GC scan <20ms @ 300M+ objects 64 Gb taken) Logging with 8+ destinations/sinks(text, email, flood filter etc.) Distributed contact-oriented communication framework NFX.Glue (replaces WCF) Security with users, credentials, roles, permissions JSON parsing, ser/deser support Ultra efficient Binary serialization support Erlang CLR support with native types: tuples, lists, pattern matching Text lexing/parsing and processing pipeline: C# lexer, JSON lexer/Parser RelationalSchema language compiler - generate DDL for different targets Templatization engine (for web, emails and not only textual content) NFX.WAVE - Web Server with hybrid injectable threading model (replaces IIS + ASP.NET) NFX.WAVE.Mvc - MVC framework for web pages WV.js - a web component library auto-bindable to server MVC/MVVM Database access layer with virtual commands/queries/transactions ID generation - GlobalDistributed IDS (GDID), FID - fast process-wide ID Virtual Social Network - Twitter/Facebook/Google+ et al Virtual Payment Processing - Stripe,PayPal providers Virtual File Systems - AmazonS3, SVN, Local QR Code Creation In progress: Virtual document model with rendering to PDF, HTML and other formats In Progress: PDF DOM model + rendering
Out-of-process OpenTelemetry capture for Kronikol: an OTLP/HTTP trace receiver-tee that accepts `POST /v1/traces` (protobuf and JSON, gzip), optionally forwards the export byte-for-byte to a real collector, and maps database, HTTP, messaging and RPC client spans to Kronikol interactions attributed by W3C trace id. Gives sequence diagrams exact attribution for hops that cannot be proxied, in any language that already exports OTLP. Also the outbound direction: `OtlpExporter` and the streaming `OtlpExportSink` push Kronikol's captured interactions to Tempo/Jaeger/any collector as OTel spans over OTLP/JSON, preserving captured W3C ids and grouping one test as one trace.
The fastest way to publish your SQL database as a GraphQL API.
Provides ability to track changes to data models through watching changes to the selected instances. You are able to determine if the entities have changes to properties, new items have been added or when an item has been deleted. The framework allows you to batch processing of changes and perform updates in single operations. It provides similar functionality to the Micrsoft EntityFramework but on a much lighter basis and without any database component. The framework was specifically designed for Blazor where the data is sent to the client using JSON serialization and then changes are made which need to be sent back to the server in batches.