Simple benchmark framework (in active development)
A ``pytest`` fixture for benchmarking code. It will group the tests into rounds that are calibrated to the chosen timer.
Reversible Data Transforms
OpenMMLab Detection Toolbox and Benchmark
Metrics for multiple object tracker benchmarking.
A library to benchmark code snippets.
Airspeed Velocity: A simple Python history benchmarking tool
Benchmarking QRC measures the ability to store information of different quantum particles
Python module to run and analyze benchmarks
Pytest plugin to create CodSpeed benchmarks
Store data created during your pytest tests execution, and retrieve it at the end of the session, e.g. for applicative benchmarking purposes.
OpenMMLab Image Classification Toolbox and Benchmark
QCVV and Benchmarking
Open MMLab Semantic Segmentation Toolbox and Benchmark
Massive Text Embedding Benchmark
provides a common interface to many IR ad-hoc ranking benchmarks, training datasets, etc.
Scikit-learn-compatible datasets
Macrobenchmarking framework for OpenSearch
Benchmark Runner Tool
Benchmark your code
OpenMMLab Pose Estimation Toolbox and Benchmark.
OpenMMLab Model Pretraining Toolbox and Benchmark
A public and reproducible collection of reference implementations and benchmark suite for distributed machine learning systems.
CLIP-like models benchmarks on various datasets
A Heterogeneous Benchmark for Information Retrieval
Library and Client for managing, benchmarking, and interacting with jupyterhub
Adapters for Running and Tracking Benchmarks
A Python wrapper for the Penn Machine Learning Benchmark data repository.
Tools to benchmark, deploy and monitor prediction market agents.
Evaluating single-cell data integration methods
Redis benchmark run helper. A wrapper around Redis and Redis Modules benchmark tools ( ftsb_redisearch, memtier_benchmark, redis-benchmark, aibench, etc... ).
Publically available datasets for benchmarking and evaluation.
OpenMMLab Video Understanding Toolbox and Benchmark
WorkArena benchmark for BrowserGym
GBD Tools: Maintenance and Distribution of Benchmark Instances and their Attributes
This is an unofficial, use-at-your-own risks port of the webarena benchmark, for use as a standalone library package.
rliable: Reliable evaluation on reinforcement learning and machine learning benchmarks.
Library for working with compliance benchmarks and data.
MiniWoB++ benchmark for BrowserGym
WebArena benchmark for BrowserGym
A collection of benchmark functions for mathematical optimization algorithms.
Silero Models: pre-trained enterprise-grade STT / TTS models and benchmarks.
MEALPY: An Open-source Library for Latest Meta-heuristic Algorithms in Python
Fuzzy Data Benchmark