Compression

The missing Python utility to read and write large compressed JSONs.

Format and compress XML documents

Compress stream by GZIP on the fly.

A compression-based edit distance metric for text comparison

Limited Error Raster Compression

Good compression for numerical sequences

A library for compressing large language models utilizing the latest techniques and research in the field for both training aware and post training techniques. The library is designed to be flexible and easy to use on top of PyTorch and HuggingFace Transformers, allowing for quick experimentation.

SC Compression

Python bindings for the LZMA library by Igor Pavlov.

LZW compression and decompression

Cramjam integration for Starlette ASGI framework.

Python wrapper for multithreaded .png image file optimizer oxipng

Infrastructure for support neural networks compression

Effortlessly compress / decompress any RINEX file

Columnar and compressed data containers.

Geobuf is a compact binary geospatial format for lossless compression of GeoJSON.

Python bindings for the LZO data compression library

A library for handling common compression formats for N64 games

Python Binding for RVL depth compression

Data compression methods and benchmarks for Cli/Met datasets

Neuroglancer compressed_segmentation codec.

A Python Geohash Compression Tool

Crackle 3D dense segmentation compression codec.

Internet Archive PDF compression tools

Deduplicated, encrypted, authenticated and compressed backups

Pure Python implementation of the XZ file format with random access support

Tar (and compress) files in s3

bz3 compress and decompress

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

A package for canonical Huffman compression

Zstd compression ASGI middleware

Library for utilization of compressed safetensors of neural network models

Lossless compression for electrophysiology time-series

A PyTorch library and evaluation platform for end-to-end compression research

Middleware that compresses response using brotli algorithm.

PPMd compression/decompression library

zfp compression in Python

A set of tools to compress gensim fasttext models

Services for compression and transfer of aind-data to the cloud

Data compression ops for TensorFlow

A more pythonic wrapper around the MSNumpress library for mass spectrometry numerical data compression

Entropy coders for research and production (Rust and Python).

Python bindings for the Xpress9 compression library

GPU inference for losslessly compressed (DFloat11) Large Language Models

It is an image compression Python package based on Singular Value Decomposition (SVD) technology. This tool offers an efficient block-based image compression method, reducing the storage requirements of images by dividing them into blocks and applying SVD, while retaining as much visual information as possible.

CLI + Python API for batch compressing PDFs with iLovePDF.com

Python bindings to the heatshrink library

Lzip (.lz) archives compression and decompression with buffers and URLs support