Tools for language models
The goal of the Indic NLP Library is to build Python based libraries for common text processing and Natural Language Processing in Indian languages.
Morphological analyzer (POS tagger + inflection engine) for Russian language.
A universal metric for Generative Large Language Models (GLLMs)
Abydos NLP/IR library
The agile query language for semi-structured data. #JSON
Python interface for the OPA Rego Language and Runtime
A language-agnostic dependency manager using Git.
Evolutionary Scale Modeling (esm): Pretrained language models for proteins. From Facebook AI Research.
Byte-pair embeddings in 275 languages
Common workflow language reference implementation
Generate SQL queries from natural language
Module for automatic summarization of text documents and HTML pages.
Compile MDL language with explicit scoping into a Minecraft datapack (1.21+ ready). Features variables, control flow, error handling, and VS Code extension.
Python Vietnamese Toolkit
[Contract Language | Chialisp] Virtual Machine
FlyDSL - ROCm Domain Specific Language for layout algebra (Python + embedded MLIR runtime)
A fast python implementation of full ROUGE metrics for automatic summarization.
The Home Assistant Intent Language parser
Light-weight sentence tokenizer for Chinese languages.
Wordnet interface library
Docspec is a JSON object specification for representing API documentation of programming languages.
A very small text templating language
Utilities for MinerU Vision-Language models
A language model suite for numbering antigen receptor sequences.
Package to compile and analyze quantum algorithms for simulating fermionic systems.
PloneLanguageTool allows you to set the available languages in your Plone site, select various fallback mechanisms, and control the use of flags for language selection and translations.
Fugue SQL Antlr Parser
Microsoft Azure Cognitive Services LUIS Client Library for Python
Soundex algorith implementation for English and Indian languages
Five-track paired counterfactual benchmark for language-conditioned driving
The Quadrants Programming Language
A language server for sphinx/docutils based documentation projects.
Upgrade a CWL tool or workflow document from one version to another
A Language Server Protocol implementation for Ruff.
NeMo text processing for ASR and TTS
For Language Detection
Language Server Protocol for Suricata signatures
Python bindings for go-enry language detector
LLM-Guard is a comprehensive tool designed to fortify the security of Large Language Models (LLMs). By offering sanitization, detection of harmful language, prevention of data leakage, and resistance against prompt injection attacks, LLM-Guard ensures that your interactions with LLMs remain safe and secure.
Command line interface for RobotCode
[RAGFlow](https://ragflow.io/) is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding. It offers a streamlined RAG workflow for businesses of any scale, combining LLM (Large Language Models) to provide truthful question-answering capabilities, backed by well-founded citations from various complex formatted data.
Collection of stopwords for multiple languages, using ISO 639-1 language code.
A small, closed object query language and SQL compiler for Gramps genealogy data
Language tags made easy