Text Processing

Virtual file format for text processing

Determine the East Asian Width of a Unicode character

A convertor between XML text and Javascript object / JSON text.

Bindings for RE2: fast, safe alternative to backtracking regular expression engines.

Markdown parser, done right. 100% Commonmark support, extensions, syntax plugins, high speed - all in one.

retext plugin to serialize prose

Promptbook: Run AI apps in plain human language across multiple models and platforms

vfile utility to read and write to the file system

Elegant console output, borrowed from Yarn

easier than regex string matching patterns for urls and other strings. turn strings into data or data into strings.

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

Javascript markdown parsing, made simple

A sensible Markdown parser for javascript

A module for node.js and the browser that takes in text and returns text that is stripped of stopwords. Has pre-defined stopword lists for 62 languages and also takes lists with custom stopwords as input.

Teams Toolkit CLI is a text-based command line interface that can help scaffold, validate, and deploy applications for Microsoft Teams from the terminal or a CI/CD process.

TeamsFx CLI a text-based command line interface that can help scaffold, validate, and deploy applications for Microsoft Teams from the terminal or a CI/CD process.

Webpack plugin to use in addition to [extract-text-webpack-plugin](https://github.com/webpack/extract-text-webpack-plugin) to create a second css bundle, processed to be rtl.

The Retrieval-Augmented Generation (RAG) module contains document processing and embedding utilities.

Helps to prevent widow words in a text


DevExpress Rich Text Editor is an advanced word-processing tool designed for working with rich text documents.

MCP server for terminal operations and file editing

Count the number of OpenAI tokens in a string. Supports all OpenAI Text models (text-davinci-003, gpt-3.5-turbo, gpt-4)

Parsing Library for Typescript and Javascript.

[![github actions][actions-image]][actions-url] [![coverage][codecov-image]][codecov-url] [![dependency status][deps-svg]][deps-url] [![dev dependency status][dev-deps-svg]][dev-deps-url] [![License][license-image]][license-url] [![Downloads][downloads-im

Core engine to convert extended MDAST to DOCX. Supports plugins for footnotes, images, lists, tables, and more. Designed for seamless Markdown-to-DOCX conversion.

Configurable BM25 Text Search Engine with simple semantic search support

Plugin for Remarkable to process embedded math expressions in Markdown text.

Extended MDAST types and custom node data for mdast2docx with support for DOCX formatting.

Plugin to convert ordered and unordered lists from Markdown (MDAST) to DOCX. Supports nesting, custom bullets, and numbering styles.

Convert Markdown Abstract Syntax Tree (MDAST) to DOCX seamlessly. Supports footnotes, images, links, and customizable document properties.

A plugin for @m2d/core that parses emoji shortcodes like :smile: and replaces them with their corresponding Unicode emoji characters for DOCX output.

Promptbook: Run AI apps in plain human language across multiple models and platforms

Util collection for Japanese text processing. Hiraganize, Katakanize, and Romanize.

MDAST to DOCX plugin for resolving and embedding images. Supports base64, URLs, and custom resolvers for seamless DOCX image integration.

Plugin to convert Markdown tables (MDAST) to DOCX with support for rich formatting and seamless integration into mdast2docx.

🔪 chunk/split a string by length without cutting/truncating words.

Plugin to convert mathematical expressions in Markdown (MDAST) to DOCX using LaTeX-style syntax. Integrates seamlessly with mdast2docx.

Extend MDAST by parsing embedded HTML in Markdown. Converts HTML into structured MDAST nodes compatible with @m2d/core for DOCX generation.

A convertor between XML text and Javascript object / JSON text. Forked to add Graphite specific features.

novel-segment segment data

A converter between XML text and Javascript object / JSON text.

A web SDK for word processing and rich text capabilities.

Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本

A speech to text module for the discord voice implementation

Javascript SDK for Sensible, the developer-first platform for extracting structured data from documents so that you can build document-automation features into your SaaS products

Node PDF is a set of tools that takes in PDF files and converts them to usable formats for data processing. The library supports both extracting text from searchable pdf files as well as performing OCR on pdfs which are just scanned images of text

A unified plugin to prepare MDAST trees for DOCX conversion using mdast2docx.

Javascript BPE Encoder Decoder for GPT-2 / GPT-3. The "gpt-3-encoder" module provides functions for encoding and decoding text using the Byte Pair Encoding (BPE) algorithm. It can be used to process text data for input into machine learning models, or to

Anonymize-NLP is a lightweight and robust package for text anonymization. It uses Natural Language Processing (NLP) and Regular Expressions (Regex) to identify and mask sensitive information in a string.,