🎩 You're Invited:Meet the Socket team at Black Hat in Las Vegas, August 3-6.RSVP
Sign In

@open-evals/metrics

Package Overview
Dependencies
Maintainers
1
Versions
7
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

@open-evals/metrics

Metrics for Open Evals

latest
Source
npmnpm
Version
0.1.4
Version published
Weekly downloads
10
-64.29%
Maintainers
1
Weekly downloads
 
Created
Source

@open-evals/metrics

Pre-built evaluation metrics for RAG and LLM applications.

Installation

pnpm add @open-evals/metrics

Features

  • Faithfulness: Measures how grounded responses are in the provided context
  • Factual Correctness: Evaluates factual accuracy against reference answers
  • Answer Similarity: Semantic similarity between generated and reference answers
  • Context Recall: Measures retrieval quality against reference answers
  • Noise Sensitivity: Tests robustness against irrelevant context
  • Evalite Integration: Convert metrics to Evalite scorers

FAQs

Package last updated on 21 Oct 2025

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts