Simple benchmark framework (in active development)
A ``pytest`` fixture for benchmarking code. It will group the tests into rounds that are calibrated to the chosen timer.
OpenMMLab Detection Toolbox and Benchmark
Reversible Data Transforms
Massive Text Embedding Benchmark
QCVV and Benchmarking
A Heterogeneous Benchmark for Information Retrieval
Benchmarking QRC measures the ability to store information of different quantum particles
Airspeed Velocity: A simple Python history benchmarking tool
Metrics for multiple object tracker benchmarking.
A library to benchmark code snippets.
Open MMLab Semantic Segmentation Toolbox and Benchmark
Python module to run and analyze benchmarks
Benchmark your code
OpenMMLab Image Classification Toolbox and Benchmark
Scikit-learn-compatible datasets
Store data created during your pytest tests execution, and retrieve it at the end of the session, e.g. for applicative benchmarking purposes.
Pytest plugin to create CodSpeed benchmarks
Macrobenchmarking framework for OpenSearch
provides a common interface to many IR ad-hoc ranking benchmarks, training datasets, etc.
Benchmark Runner Tool
OpenMMLab Model Pretraining Toolbox and Benchmark
OpenMMLab Pose Estimation Toolbox and Benchmark.
A public and reproducible collection of reference implementations and benchmark suite for distributed machine learning systems.
Python Optimization Benchmarking Functions
CLIP-like models benchmarks on various datasets
GBD Tools: Maintenance and Distribution of Benchmark Instances and their Attributes
Evaluating single-cell data integration methods
Fuzzy Data Benchmark
Redis benchmark run helper. A wrapper around Redis and Redis Modules benchmark tools ( ftsb_redisearch, memtier_benchmark, redis-benchmark, aibench, etc... ).
Fix Inventory Compliance Benchmarks and Checks
Publically available datasets for benchmarking and evaluation.
A Python wrapper for the Penn Machine Learning Benchmark data repository.
Benchmarking framework for noisy optimization and experiment planning
OpenMMLab Video Understanding Toolbox and Benchmark
Library and Client for managing, benchmarking, and interacting with jupyterhub
Merlion: A Machine Learning Framework for Time Series Intelligence
Quick and easy python benchmarking.
Opfunu: An Open-source Python Library for Optimization Benchmark Functions
Tools for measuring sensitivity and diversity of multi-task benchmarks.
A study to benchmark whisper based ASRs in Malayalam
MEALPY: An Open-source Library for Latest Meta-heuristic Algorithms in Python
Python benchmark suite
Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis.
Set of robot URDFs for benchmarking and developed examples.
rliable: Reliable evaluation on reinforcement learning and machine learning benchmarks.
AI Benchmark is an open source python library for evaluating AI performance of various hardware platforms, including CPUs, GPUs and TPUs.