Datasets for benchmarking Semantic Modeling problem
Benchmark QCD physics
A PyTorch library for benchmarking deep metric learning. It's powerful.
Python package of ADBench
Repostory of Protein Benchmarking and Modeling
perfbench measures execution time of code snippets with Timeit and uses Plotly to visualize the results.
A simple benchmarking library
Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google Palm2/Vertex, Mistral, Ollama, AI21, Cohere, Aleph-Alpha, HuggingfaceHub), with a built-in model performance benchmark.
Code utilities for the CESPED (Cryo-EM Supervised Pose Estimation Dataset) benchmark
🦜💪 Flex those feathers!
PyAnaDroid: A replicable, fully-customizable execution pipeline foranalyzing and benchmarking Android Applications
A comprehensive toolkit for large model evaluation
ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills
Benchmark suite tool
Reproducible and Reusable Data Analysis Workflow Server (Core Infrastructure)
A gym that contains the memory benchmarks Mortar Mayhem, Mystery Maze and Searing Spotlights
Benchmark Python Scripts
A test bench to benchmark learn algorithms for graphical models
Create charts from FIO storage benchmark tool output
A package for benchmarking time series machine learning tools.
Benchmarking library for generative algorithms in omics data
MiniWoB++ benchmark for BrowserGym
GNSS benchmarking tool
Easily benchmark PyTorch model FLOPs, latency, throughput, max allocated memory and energy consumption in one go.
Genomic Benchmarks
WebArena benchmark for BrowserGym
ジョブショップスケジューリング問題のベンチマーク問題をpythonのクラスで表現し,load出来るようにする
Benchmark dataset for learning dynamical systems from data
A simple ANN benchmark tools
DBMS-Benchmarker is a Python-based application-level blackbox benchmark tool for Database Management Systems (DBMS). It connects to a given list of DBMS (via JDBC) and runs a given list of parametrized and randomized (SQL) benchmark queries. Evaluations are available via Python interface, in reports and at an interactive multi-dimensional dashboard.
This tool safely and securely analyzes applications for benchmarking.
Richbench, a little benchmarking tool
This python tools helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.
Package for connecting SEED data to Salesforce
Bayesian optimization benchmark system
A Gallery for Benchmarking Graph Neural Networks and Graph Adversarial Learning.
Fairness-aware machine learning: algorithms, comparisons, benchmarking
Fibber is a benchmarking suite for adversarial attacks on text classification.
SwiftStack Swift Benchmarking Suite
Opinionated Benchmarking Automatation in Galaxy
Optimization benchmarks, both synthetic and practical.
AI Maintainer Agent Harness for our benchmarking and Marketplace API and platform
A Python interface for the USEPA Benchmark dose modeling software (BMDS)