Simple benchmark framework (in active development)
A ``pytest`` fixture for benchmarking code. It will group the tests into rounds that are calibrated to the chosen timer.
Python Optimization Benchmarking Functions
Massive Text Embedding Benchmark
Reversible Data Transforms
OpenMMLab Detection Toolbox and Benchmark
Metrics for multiple object tracker benchmarking.
A Heterogeneous Benchmark for Information Retrieval
Benchmarking QRC measures the ability to store information of
Pytest plugin to create CodSpeed benchmarks
Python module to run and analyze benchmarks
OpenMMLab Image Classification Toolbox and Benchmark
Airspeed Velocity: A simple Python history benchmarking tool
Store data created during your pytest tests execution, and retrieve it at the end of the session, e.g. for applicative benchmarking purposes.
Open MMLab Semantic Segmentation Toolbox and Benchmark
QCVV and Benchmarking
A Python Toolbox for Benchmarking Machine Learning on Partially-Observed Time Series
provides a common interface to many IR ad-hoc ranking benchmarks, training datasets, etc.
Benchmark Runner Tool
🦜💪 Flex those feathers!
Interactive Benchmarking for Machine Learning.
Benchmark your code
OpenMMLab Pose Estimation Toolbox and Benchmark.
MiniWoB++ benchmark for BrowserGym
WebArena benchmark for BrowserGym
WorkArena benchmark for BrowserGym
This is an unofficial, use-at-your-own risks port of the webarena benchmark, for use as a standalone library package.
OpenMMLab Model Pretraining Toolbox and Benchmark
Scikit-learn-compatible datasets
A public and reproducible collection of reference implementations and benchmark suite for distributed machine learning systems.
Tools to benchmark, deploy and monitor prediction market agents.
Redis benchmark run helper. A wrapper around Redis and Redis Modules benchmark tools ( ftsb_redisearch, memtier_benchmark, redis-benchmark, aibench, etc... ).
A collection of benchmark functions for mathematical optimization algorithms.
A library to benchmark code snippets.
The Redis benchmarks specification describes the cross-language/tools requirements and expectations to foster performance and observability standards around redis related technologies. Members from both industry and academia, including organizations and individuals are encouraged to contribute.
Evaluating single-cell data integration methods
A Python wrapper for the Penn Machine Learning Benchmark data repository.
Adapters for Running and Tracking Benchmarks
CLIP-like models benchmarks on various datasets
GBD Tools: Maintenance and Distribution of Benchmark Instances and their Attributes
Macrobenchmarking framework for OpenSearch
Library for working with compliance benchmarks and data.
Quick and easy python benchmarking.
Sample implementation of babymmlu benchmark
Python benchmark suite
This is an unofficial, use-at-your-own risks port of the visualwebarena benchmark, for use as a standalone library package.
OpenMMLab Video Understanding Toolbox and Benchmark
MEALPY: An Open-source Library for Latest Meta-heuristic Algorithms in Python