Opfunu: An Open-source Python Library for Optimization Benchmark Functions
A study to benchmark whisper based ASRs in Malayalam
MEALPY: An Open-source Library for Latest Meta-heuristic Algorithms in Python
Platform Performance Benchmarking
Benchmark performance of **any model** deployed on **Amazon SageMaker** or available on **Amazon Bedrock** or deployed by you on an AWS service of choice (such as Amazon EKS or Amazon EC2) a.k.a **Bring your own endpoint**.
WILDS distribution shift benchmark
Electrical Power System Benchmark Models.
Tiny Python benchmarking library
Constrained multiobjective benchmark suites and indicators
Quick and easy python benchmarking.
Benchmarking the performance of agents far and wide, regardless of how they are set up and how they work
A package containg benchmark instances for the Job Shop Scheduling Problem (JSP) scraped from
Check the accuracy of one VCF callset against another
a machine learning benchmark for materials science
Superseded by: gbd-tools
A package to download, load, and process multiple benchmark multi-omic drug response datasets
New machine learning benchmarks from tabular datasets.
Modern benchmarking library for python with pytest integration.
Rotation Detection Toolbox and Benchmark
Simple probabilistic time series benchmark models
natural intelligence benchmarks for scikit-learn
The Redis benchmarks specification describes the cross-language/tools requirements and expectations to foster performance and observability standards around redis related technologies. Members from both industry and academia, including organizations and individuals are encouraged to contribute.
A package for benchmarking the performance of arbitrary functions
Benchmarks library, based on the package teneva, for testing multivariate approximation and optimization methods
Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis.
Rotation Detection Toolbox and Benchmark
Continuous Benchmarking (CB) Framework
Loop Kernel Analysis and Performance Modeling Toolkit
Scandinavian Embedding Benchmark
OpenMMLab Image and Video Editing Toolbox and Benchmark
robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
Benchmark toolkit for optimization
AI Benchmark is an open source python library for evaluating AI performance of various hardware platforms, including CPUs, GPUs and TPUs.
CLI extension for AEA framework benchmarking.
A library for training and benchmarking RL agents on graphs.
Unfied Semi-Supervised Learning Benchmark
Easily benchmark Machine Learning models on selected tasks and datasets
I/O profiler for deep learning python apps. Specifically for dlio_benchmark.
Python Interface to lfk-mp-benchmark
Quisby is a data processing and visualization tool for benchmark testing.
Fix Inventory Compliance Benchmarks and Checks
Benchmark for language models
Omnibenchmark core utilities: Setup and running of continous benchmarking modules as part of omnibenchmark
Causal AI Benchmarking Framework
VectorDBBench is not just an offering of benchmark results for mainstream vector databases and cloud services, it's your go-to tool for the ultimate performance and cost-effectiveness comparison. Designed with ease-of-use in mind, VectorDBBench is devised to help users, even non-professionals, reproduce results or test new systems, making the hunt for the optimal choice amongst a plethora of cloud services and open-source vector databases a breeze.
Benchmark functions that returns total space, mem, cpu given input size and parameters for the CWL workflows
Open Source Architecture Code Analyzer
Easily benchmark Machine Learning models on selected tasks and datasets - with PyTorch
Datasets for benchmarking Semantic Modeling problem