NLP

HuggingFace/NLP is an open library of NLP datasets.

Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Natural language processing augmentation library for deep neural networks

Natural Language Toolkit

Industrial-strength Natural Language Processing (NLP) in Python

Python extension for the NLP++ text analysis engine

Embeddings, Retrieval, and Reranking

Thai Natural Language Processing library

The official SWE-bench package - a benchmark for evaluating LMs on software engineering

John Snow Labs Spark NLP is a natural language processing library built on top of Apache Spark ML. It provides simple, performant & accurate NLP annotations for machine learning pipelines, that scale easily in a distributed environment.

Mini SWE Agent - A simple AI software engineering agent

Parse partial JSON generated by LLM

Python client for the NLP Cloud API

Interface between LLMs and your data

Unsupervised Korean Natural Language Processing Toolkits

Chinese Words Segmentation Utilities

A Python library for splitting text into smaller chunks while preserving as much local semantic context as possible.

ModelScope: bring the notion of Model-as-a-Service to life.

Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores

An accurate natural language detection library, suitable for short text and mixed-language text

Kana kanji simple inversion library

Parse human names into title, given, middle, family, suffix, nickname and maiden name. Typed, zero-dependency, CJK-aware.

pysbd (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box across many languages.

Python binding for nlpO3 Thai language processing library in Rust

A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 61 detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.

Pure python spell checker based on work by Peter Norvig

Simple, Pythonic text processing. Sentiment analysis, part-of-speech tagging, noun phrase parsing, and more.

The goal of the Indic NLP Library is to build Python based libraries for common text processing and Natural Language Processing in Indian languages.

A library that prepares raw documents for downstream ML tasks.

Vietnamese Newspapaper classifier

Parse and convert numbers written in French, Spanish, English, Portuguese, German, Dutch, Danish, or Italian into their digit representation.

natural language processing primitives for Featuretools

Interface between LLMs and your data

Calculate syllable counts for English words.

Local-first SDK for clinical extraction and de-identification workflows on hardware you control.

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense chunking library

Python package for Korean natural language processing.

Neural networks for NLP tasks

Python library for processing Chinese text

Sentence segmenter that supports ~300 languages

Enterprise-ready Natural Language to SQL converter with multi-provider support. Built for production scale (1000+ tables) with Clean Architecture.

Sandboxed code execution for AI agents, locally or on the cloud.

A Python NLP Library for Many Human Languages, by the Stanford NLP Group

Pretrained models for Keras.

NLP Chinese Data Augmentation.一键中文数据增强.NLP数据增强

A Python package to parse structured information from recipe ingredient sentences

An open-source NLP research library, built on PyTorch.

An open-source NLP research library, built on PyTorch.

Generalist model for NER (Extract any entity types from texts)