AB test analysis toolbox for analyzing and reporting the results of an ab test experiment. It provides the functions to analyze the ab test result of an experiment.
A/B testing is process which allows developer/data scientist to analyze and evaluate, the performance of products in an experiment. In this process two or more versions of a variable (web page, page element, products etc.) are shown to different segments of website visitors at the same time to determine which version leaves the maximum impact and drives business metrics.
In A/B testing, A refers to the original testing variable. Whereas B refers to a new version of the original testing variable. Impact of the results can be evaluated based on,
pip install ab-testing-analysis
Usages & working sample - Tutorial
Example code,
from ab_testing import ABTest
from ab_testing.data import Dataset
df = Dataset().data()
ab_obj = ABTest(df,response_column='Response',group_column='Group')
print(ab_obj.conversion_rate(),'\n','-'*10)
print(ab_obj.significance_test(),'\n','-'*10)
print(df.head())
Output:
Conversion Rate Standard Deviation Standard Error
A 20.20% 0.401 0.018
B 22.20% 0.416 0.0186
----------
z statistic: -0.77 p-value: 0.439
Confidence Interval 95% for A group: 16.68% to 23.72%
Confidence Interval 95% for B group: 18.56% to 25.84%
The Group A fail to perform significantly different than group B.
The P-Value of the test is 0.439 which is above 0.05, hence Null hypothesis Hₒ cannot be rejected.
----------
Users Response Group
0 IS36FC7AQJ 0 A
1 LZW2YNYHZG 1 A
2 9588IGN0RN 1 A
3 HSAH1TYQFF 1 A
4 5D9G147941 0 A
All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.
A detailed overview on how to contribute can be found in the contributing guide.
As contributors and maintainers to this project, you are expected to abide by code of conduct. More information can be found at Code of conduct
Slide deck for library demo - AB Test analysis - PPT/Deck
Colab Notebook for walkthrough - Notebook ipynb
FAQs
AB test analysis toolbox for analyzing and reporting the results of an ab test experiment. It provides the functions to analyze the ab test result of an experiment.
We found that ab-testing-analysis demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
PyPI confirms no security flaws were exploited in the Ultralytics supply chain attack and highlights improvements for safer package publishing.
Security News
Research
The Socket Research Team breaks down a malicious wrapper package that uses obfuscation to harvest credentials and exfiltrate sensitive data.
Research
Security News
Attackers used a malicious npm package typosquatting a popular ESLint plugin to steal sensitive data, execute commands, and exploit developer systems.