Research
Security News
Malicious npm Package Targets Solana Developers and Hijacks Funds
A malicious npm package targets Solana developers, rerouting funds in 2% of transactions to a hardcoded address.
Evalica [ɛˈʋalit͡sa] (eh-vah-lee-tsah) is a Python library that transforms pairwise comparisons into ranked lists of items. It offers convenient high-performant Rust implementations of the corresponding methods via PyO3, and additionally provides naïve Python code for most of them. Evalica is fully compatible with NumPy arrays and pandas data frames.
The logo was created using Recraft.
Imagine that we would like to rank the different meals and have the following dataset of three comparisons produced by food experts.
Item X | Item Y | Winner |
---|---|---|
pizza | burger | x |
burger | sushi | y |
pizza | sushi | tie |
Given this hypothetical example, Evalica takes these three columns and computes the outcome of the given pairwise comparison according to the chosen model. Note that the first argument is the column Item X
, the second argument is the column Item Y
, and the third argument corresponds to the column Winner
.
>>> from evalica import elo, Winner
>>> result = elo(
... ['pizza', 'burger', 'pizza'],
... ['burger', 'sushi', 'sushi'],
... [Winner.X, Winner.Y, Winner.Draw],
... )
>>> result.scores
pizza 1014.972058
burger 970.647200
sushi 1014.380742
Name: elo, dtype: float64
As a result, we obtain Elo scores of our items. In this example, pizza
was the most favoured item, sushi
was the runner-up, and burger
was the least preferred item.
Item | Score |
---|---|
pizza | 1014.97 |
burger | 970.65 |
sushi | 1014.38 |
Evalica also provides a simple command-line interface, allowing the use of these methods in shell scripts and for prototyping.
$ evalica -i food.csv bradley-terry
item,score,rank
Tacos,2.509025136024378,1
Sushi,1.1011561298265815,2
Burger,0.8549063627182466,3
Pasta,0.7403814336665869,4
Pizza,0.5718366915548537,5
Refer to the food.csv file as an input example.
Evalica has a built-in Gradio application that can be launched as python3 -m evalica.gradio
. Please ensure that the library was installed as pip install evalica[gradio]
.
Method | In Python | In Rust |
---|---|---|
Counting | ✅ | ✅ |
Average Win Rate | ✅ | ✅ |
Bradley–Terry | ✅ | ✅ |
Elo | ✅ | ✅ |
Eigenvalue | ✅ | ✅ |
PageRank | ✅ | ✅ |
Newman | ✅ | ✅ |
Copyright (c) 2024 Dmitry Ustalov. See LICENSE for details.
FAQs
Evalica, your favourite evaluation toolkit.
We found that evalica demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Research
Security News
A malicious npm package targets Solana developers, rerouting funds in 2% of transactions to a hardcoded address.
Security News
Research
Socket researchers have discovered malicious npm packages targeting crypto developers, stealing credentials and wallet data using spyware delivered through typosquats of popular cryptographic libraries.
Security News
Socket's package search now displays weekly downloads for npm packages, helping developers quickly assess popularity and make more informed decisions.