URL Parsing

Accurately separates a URL's subdomain, domain, and public suffix, using the Public Suffix List (PSL). By default, this includes the public ICANN TLDs and their exceptions. You can optionally support the Public Suffix List's private domains as well.

Parsing and validation of URIs (RFC 3986) and IRIs (RFC 3987)

A Git URL parsing module (supports parsing and rewriting)

Fast and robust extraction of original and updated publication dates from URLs and web pages.

Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters.

python-benedict is a dict subclass with keylist/keypath/keyattr support, normalized I/O operations (base64, csv, ini, json, pickle, plist, query-string, toml, xls, xml, yaml) and many utilities... for humans, obviously.

git-url-parse - A simple GIT URL parser.

parse dsn urls

Simple URL parsing, canonicalization and equivalence.

Python package for finding and parsing indicators of compromise from text.

Parse and build Amazon S3 URLs

Process Mozilla's repository URLs. The intent is to centralize URLs parsing.

urlparse3 is simple and powerful url parsing tool

A mostly universal library to parse and compare software package versions and version ranges. A companion to Package URLs.

A module to parse metadata out of urls and html documents

The `abstract_apis` module is designed to facilitate HTTP requests in Python applications, particularly those that require handling JSON data, dealing with custom API endpoints, and parsing complex nested JSON responses. The module simplifies request handling by abstracting away common tasks such as header management, URL construction, and response parsing.

SlimURL - Fast library for parsing and building URL addresses

Parse url and get all the different parts out of it

A small tool to parse URLs for S3 compatible storage services

Parsing and validating git urls.

URL Parsing

Meatie is a Python typed REST client library that eliminates the need for boilerplate code when integrating with external APIs. The library generates code for calling a REST API based on method signatures annotated with type hints. Meatie abstracts away mechanics related to HTTP communication, such as building URLs, encoding query parameters, parsing, and dumping Pydantic models. With some modest additional configuration effort, generated HTTP clients offer rate limiting, retries, and caching.

Parsing and validating git urls.

The library is responsible for parsing a cURL request string and converting it into a Python dictionary containing the method, URL, headers, and data

Parse & construct GitHub repository URLs & specifiers

A parser that parses articles from any url or html

A collection of performant parsing utilities

Scraping library by crawling link patterns, url and parsing

Some functions to parse and normalize URLs.

Parse robots.txt files and find indexed urls

Convenient utility to parse and normalize urls.

Package for parsing AO3 pages into works and creating urls based on requirements.

Simple package for parsing querystrings into nested dictionaries and vice versa.

Python package for finding and parsing indicators of compromise from text.

Prompt-AI is a Python library that automates the process of generating AI-powered newsletters. It scrapes content from a given URL, generates a structured newsletter using Google's Gemini API, and provides features for parsing content, sending emails, and creating blog page links.

Cognism URL component parser. General purpose.

Performance-focused replacement for Python's urlparse module

Tools for parsing, extracting, reconciling, and unshortening urls

The library makes parsing and manipulation of URL🌐 and Email address📧 easy.

Parse URLs for DOIs, PubMed identifiers, PMC identifiers, arXiv identifiers, etc.

Filter backend for DjangoRestFramework able to parse url parameters

a slight preparser to help parse webpage content or get request from urls,which supports win, mac and unix.

parse dsn urls

Add service URL parsing support for environs

A Model Context Protocol (MCP) server that parses PDF files from a given URL into structured formats

Collects metadata from URL, or HTML content.

Extension for Python-Markdown to parse hashtag (e.g. #Python) into a user-defined URL

Parse HTTP Common Log format file for top visited urls, top ips and number of uniq ips

A utility package to parse URLs into recipes.

Python implementation of the WHATWG URL Standard