Security News
tea.xyz Spam Plagues npm and RubyGems Package Registries
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
egreedy
Advanced tools
Readme
An epsilon-greedy algorithm for multi-armed bandit problems
This implementation is based on Bandit Algorithms for Website Optimization and related empirical research in "Algorithms for the multi-armed bandit problem". In addition, this module conforms to the BanditLab/2.0 specification.
Install with npm
(or yarn
):
npm install egreedy --save
This implementation often encounters extended floating point numbers. Arm selection is therefore subject to JavaScript's floating point precision limitations. For general information about floating point issues see the floating point guide.
Create an optimizer with 3
arms and epsilon 0.25
:
const Algorithm = require('egreedy');
const algorithm = new Algorithm({
arms: 3,
epsilon: 0.25
});
Select an arm (for exploration or exploitation, according to the algorithm):
algorithm.select().then((arm) => {
// do something based on the chosen arm
});
Report the reward earned from a chosen arm:
algorithm.reward(arm, value);
Algorithm(config)
Create a new optimization algorithm.
config
(Object
): algorithm instance parametersThe config
object supports two optional parameters:
arms
(Number
, Integer): The number of arms over which the optimization will operate; defaults to 2
epsilon
(Number
, Float, 0
to 1
): lower leads to more exploration (and less exploitation); defaults to 0.5
Alternatively, the state
object resolved from Algorithm#serialize
can be passed as config
.
An instance of the egreedy optimization algorithm.
const Algorithm = require('egreedy');
const algorithm = new Algorithm();
assert.equal(algorithm.arms, 2);
assert.equal(algorithm.epsilon, 0.5);
Or, with a passed config
:
const Algorithm = require('egreedy');
const algorithm = new Algorithm({ arms: 4, epsilon: 0.75 });
assert.equal(algorithm.arms, 4);
assert.equal(algorithm.epsilon, 0.75);
Algorithm#select()
Choose an arm to play, according to the specified bandit algorithm.
None
A Promise
that resolves to a Number
corresponding to the associated arm index.
const Algorithm = require('egreedy');
const algorithm = new Algorithm();
algorithm.select().then(arm => console.log(arm));
Algorithm#reward(arm, reward)
Inform the algorithm about the payoff earned from a given arm.
arm
(Number
, Integer): the arm index (provided from Algorithm#select()
)reward
(Number
): the observed reward value (which can be 0 to indicate no reward)A Promise
that resolves to an updated instance of the algorithm. (The original instance is mutated as well.)
const Algorithm = require('egreedy');
const algorithm = new Algorithm();
algorithm.reward(0, 1).then(updatedAlgorithm => console.log(updatedAlgorithm));
Algorithm#serialize()
Obtain a plain object representing the internal state of the algorithm.
None
A Promise
that resolves to a stringify-able Object
with parameters needed to reconstruct algorithm state.
const Algorithm = require('egreedy');
const algorithm = new Algorithm();
algorithm.serialize().then(state => console.log(state));
PRs are welcome! For bugs, please include a failing test which passes when your PR is applied. Travis CI provides on-demand testing for commits and pull requests.
To enable a git hook that runs npm test
prior to pushing, cd
into the local repo and run:
touch .git/hooks/pre-push
chmod +x .git/hooks/pre-push
echo "npm test" > .git/hooks/pre-push
To run the unit test suite:
npm test
Or, to run the test suite and view test coverage:
npm run coverage
Note: Tests against stochastic methods (e.g. Algorithm#select
) are inherently tricky to test with deterministic assertions. The approach here is to iterate across a semi-random set of conditions to verify that each run produces valid output. As a result, each test suite run encounters slightly different execution state. In the future, the test suite should be expanded to include a more robust test of the distribution's properties – though because of the number of runs required, should be triggered with an optional flag.
FAQs
An epsilon-greedy multi-armed bandit algorithm
The npm package egreedy receives a total of 27 weekly downloads. As such, egreedy popularity was classified as not popular.
We found that egreedy demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
Security News
As cyber threats become more autonomous, AI-powered defenses are crucial for businesses to stay ahead of attackers who can exploit software vulnerabilities at scale.
Security News
UnitedHealth Group disclosed that the ransomware attack on Change Healthcare compromised protected health information for millions in the U.S., with estimated costs to the company expected to reach $1 billion.