Eval

Show value of an importable object

Like `typing._eval_type`, but lets older Python versions use newer typing features.

HuggingFace community-driven open-source library of evaluation

Safely evaluate AST nodes without side effects

A simple, safe single expression evaluator library.

Safe, minimalistic evaluator of python expression using ast module

Validation and secure evaluation of untrusted python expressions

Testing framework for sequence labeling

The Open-Source LLM Evaluation Framework.

A framework for evaluating language models

A getattr and setattr that works on nested objects, lists, dicts, and any combination thereof without resorting to eval

Evalica, your favourite evaluation toolkit.

Universal library for evaluating AI models

MS-COCO Caption Evaluation for Python 3

LLM Evaluations

an AutoML library that builds, optimizes, and evaluates machine learning pipelines using domain-specific objective functions

Python Mathematical Expression Evaluator

A library for providing a simple interface to create new metrics and an easy-to-use toolkit for metric computations and checkpointing.

Provides Python bindings for popular Information Retrieval measures implemented within trec_eval.

Use EvalAI through command line interface

EvalScope: Lightweight LLMs Evaluation Framework

"EvalPlus for rigourous evaluation of LLM-synthesized code"

Evaluation tools for the SIGSEP MUS database

Limited evaluator

Faster interpretation of the original COCOEval

A poker hand evaluation and equity calculation library

evalutils helps users create extensions for grand-challenge.org

Provides Python bindings for popular Information Retrieval measures implemented within trec_eval.

Contains the integration code of AzureML Evaluate with Mlflow.

Backwards-compatibility package for API of trulens_eval<1.0.0 using API of trulens-*>=1.0.0.

A custom Streamlit component to evaluate arbitrary Javascript expressions.

eval-mm is a tool for evaluating Multi-Modal Large Language Models.

Evaluating and scoring financial data

Evolve your AI application with evals!

Microsoft Azure Evaluation Library for Python

Evaluation

EM algorithms for integrated spatial and spectral models.

Performs async evaluations of strings

AlpacaEval : An Automatic Evaluator of Instruction-following Models

Serialization based on ast.literal_eval

Package for fast computation of BSS Eval metrics for source separation

Send Sir Perceval on a quest to fetch and gather data from software repositories.

A Difference Evaluator for Alternating Images

A library for providing a simple interface to create new metrics and an easy-to-use toolkit for metric computations and checkpointing.

Prompt flow evals

PMML evaluator library for Python