Reusable Tigrbl pytest fixtures, conformance assertions, integration helpers, and package test utilities.
Deterministic side-effect safety testing for LangGraph agents: fault injection and effect-ledger assertions to catch duplicate business operations.
Temporal assertions for real hardware traces: judge pulse timing, serial logs and decoded events against YAML contracts (MCP server, pytest plugin, GitHub Action)
battest is a runtime test runner for Windows batch files. It executes real cmd.exe scripts and asserts on exit codes, output, environment, and filesystem side effects.
Controlled tool failures and state assertions for AI agents
Perception & verification MCP server for AI agents: media_assert (declarative pass/fail QC for generated media), image diff (pixelmatch + SSIM), readable text tiles for small print & handwriting, video tools (frames on demand, scenes, QC defects, pacing dynamics, attention heatmaps, scene diff), and full audio DSP (pitch, BPM, key, LUFS, spectrograms).
A pytest plugin to assert type annotations at runtime.
Should assertions in Python as clear and readable as possible
A simple Django app to add html related assertions to djangos testing classes.
Big Data Quality, a set of tools/function that help you every day assert quality of datasets you have processed or ingested
Should style asserts based on pyhamcrest
typesafe - formal type asserting decorators
MCP server for testing REST API with built-in assertions
Behavioral testing for LLM applications. pytest plugin with semantic assertions, multi-turn conversation testing, and drift detection. No LLM judge needed.
Semantic assertions for pytest using LLMs
Netchecks is a cloud native tool for specifying and regularly checking assertions about network conditions. Use netchecks to proactively verify whether security controls are working as intended, alerting on misconfiguration.
Deterministic correctness testing for MCP servers
Plugin to count actual number of asserts in pytest
Simple LLM-powered assertions for any pytest test
Universal numerical verification, bit-exact ULP analysis, Safetensors checkpoint diffing, and differential testing for PyTorch, JAX, and LLM serving.
pytest plugin for mcp-assert: run MCP server assertions as pytest test items
beangulp importer for Stripe balance transactions, with a thin API client: idempotent drafts via balance-transaction ids, minor-unit conversion, fee splitting, balance-snapshot assertions, and invoice-to-charge correlation for filing customer invoice PDFs
assertion rewriting with a structured AssertionError, for Python 2.7, 3.x and RPython
Assertion functions to test Spark Collections like DataFrames.
YAML-driven safety evaluation pipeline with LiteLLM-backed stages
Verify agentic-action keystone CHAINS offline (RFC 8785 JCS + SHA-256): @name-bound composition with scope-subset, not-revoked and journey assertions, plus the agent-passport client. Cython-compiled submodules of the algovoi_keystone namespace.
A utility package for making better test assertions
A Framework for orchestrating, asserting and reporting on API calls with templates
A behavioral testing library for LLM applications that allows developers to write natural language specifications for unit and integration tests. Validate LLM application behavior using plain English assertions in a simple assert(str, str) form factor.
Test tool (Benchmark / Test / Assertion / etc...)
A python interface to produce and consume Security Assertion Markup Language (SAML) v2.0 messages.
Use a probatio schema as a pytest assertion matcher
Measures what an agent tool definition loses when converted between MCP, OpenAI, A2A, Anthropic, Gemini, Bedrock and 10 more formats. Computed, not asserted.
Tests a command line program by executing it in a temporary sandbox directory and inspecting its result.
Easily make assertions about logged messages in tests
Pytest integration for py-predicate
Google Gemini oracles for Robot Framework: text-only and multimodal (image) assertions.
Generate adversarial test inputs with a coding agent; your pytest assertions judge them
The pytest for LLMs — fast, Pydantic-based assertions for AI applications
Artefacts Toolkit helpers for recording and asserting on Rerun (.rrd) recordings
A record-then-assert mocking library
flaw2flow is a Python module made to validate data in Python
MetaPY is a package to give better type assertion.
beangulp importer for Wise balance statements (statement.json), with a thin SCA-capable API client: idempotent drafts via referenceNumber, conversion-leg merging, fee splitting, closing-balance assertions