pytest plugin for nondeterministic tests: run cases N times, report empirical pass fractions, flaky detection, and cost.
Conversation tests for AI agents: a simulated user talks to your agent through its API, a judge checks every claim, and convy reports pass rate, tokens, time and what changed between builds.
Beautiful, glowing HTML test reports for PyTest and unittest.
This little plugin will expand the html report file generated by your Robot Framework tests to display a pie chart
Convert dbt's target/run_results.json into a JUnit XML report so Azure DevOps (ADO) can display dbt test results in the Tests tab.
A Dotnet Github Markdown Coverage Report Generator
Run authorized web security regression checks in CI with JSON reports and exit codes.
Generate HTML report for your test cases / Automation cases with its steps specifying its valid status.
pytest plugin for narrativetrace: per-test trace fixtures, artifacts, and reporting
A lightweight Python toolkit for API monitoring, testing, validation, and reporting
Run narrative-to-formal translation across many language models and score it with oracles that are not language models: executable, structural and property layers, reported separately.
Data contracts and quality gates for Polars: quarantine bad rows with reasons, block bad batches, and write reports people can read.
Test a conveyor station's AMR/AGV load-handover handshake over OPC UA before the robot arrives: plays the vehicle side, also the ways a vehicle fails, and reports rule by rule.
Deterministic test-evidence checks for AI-contributed PRs: verify added tests fail before and pass after the change. Report mode never blocks.
ovui-widgets shared library: WidgetServices protocol, types, adapters, settings, selection, undo, scheduler, error reporter, icon caches, managed window, dialogs, snap, mock adapters (numpy in [testing] extra)
Support for generating reports visualizing CoreJet test runs
A test runner which can output an XML report compatible with JUnit and Hudson/Jenkins as well as XML and HTML reports compatible with the CoreJet BDD standard
TestRail API reporter tools: generate and publish test automation coverage reports from TestRail data
PyUnit-based test runner with TAP reporting.
Network benchmarking suite for DNS, HTTP, and SSL — with DNSSEC validation, DoH/DoT support, high‑concurrency testing, and enterprise‑grade reporting.
Qase Behave Plugin for Qase TestOps and Qase Report
Monitoring, Evaluation, Reporting, Inspection, Testing framework for AI systems
Runtime evidence for code changes: run a repository's existing tests against a change and report what actually executed.
Contains the common types and API client for CloudBeat
Run and track your tests, compare and export results, and catch the flaky ones. Get deeper insight with AI, using your own model.
AI-driven functional testing agent. Point it at a URL; it explores the app, generates a test plan, runs it, and reports findings. Web (Playwright) + visual regression + accessibility (axe-core) + REST API contract tests, all driven by your choice of LLM.
Famacase test management plugin for pytest. Drop-in transport swap for qase-pytest pointed at the Famacase Reporter Ingestion API.
CloudBeat Pytest Kit
Defensive WordPress security scanner. 294 checks, CVE feed aggregated nightly from up to 8 public sources, AI-assisted remediation (BYO key), check-level compliance mappings for 12 frameworks, Sigstore-signed releases with GitHub build-provenance attestations, 9 report formats plus 14 exports, a sites registry, batch scans, a --daemon scheduler, and a token-protected --api-server with a target allowlist. Authorized testing only.
Enhanced HTML reporting for pytest with categories, specifications, and detailed logging
Report training runs, epochs, test results, benchmarks and prediction frames to Visin, and read them back.
Tracera Autotest adapter for Robot Framework
Text User Interface (TUI) and HTML report for Pytest test runs
MEOK MCP Test MCP — golden-file + schema-drift + tool-failure tests for any MCP server. Drop-in pre-publish gate. Generates pytest templates. HMAC-signed test reports + Shields.io grade badge. By MEOK AI Labs.
BLogger is a Pytest plugin for enhanced test logging and generating convenient and lightweight reports.
CLI tool for generating and serving test reports
Testing and Reporting framework for Time Series Analysis
Open-source LLM evaluation framework — 50+ metrics for RAG, agents, safety, async eval, regression tracking, custom benchmarks, and exportable reports
Selenium wrapper for CloudBeat Pytest Kit
Panel data econometrics in Python: Fixed Effects, Random Effects, GMM (Arellano-Bond, Blundell-Bond), Experiment Pattern with Result Containers (Validation, Comparison, Residual), Test Runners & Master Reports, Interactive Visualizations (35 Charts), Professional HTML Reports, Robust Standard Errors (HC, Clustered, Driscoll-Kraay, Newey-West), Comprehensive Diagnostics
AI-Powered Test Intelligence SDK for Python - pytest plugin with automatic failure analysis
Tracera Autotest adapter core (HTTP + steps + result upload)
Tracera Autotest adapter for Playwright (Python)