data_science_toolbox
=====================
Various code to aid in data science projects for tasks involving data cleaning,
ETL, EDA, NLP, viz, feature engineering, feature selection, model training and validation etc.
Installation
Using pip
You can install using the pip package manager by running
pip install data-science-toolbox
Project Organization
βββ README.md
βββ data_science_toolbox <- Project source code
β β
β βββ gists <- Code gists with commonly used code (change to root
β β directory, connect to database, profile data, etc)
β βββ data_checks <- Code for data checks and assertions
β βββ io <- Code for input/output utilities
β βββ etl <- For building reproducible ETL pipelines, including data
β β checks and transformers
β βββ ml <- Machine Learning utility code (feature engineering, etc)
β βββ pandas <- Pandas related utility code
β β βββ analysis
β β βββ cleaning
β β βββ engineering
β β βββ text
β β βββ datetime
β β βββ optimization
β β βββ profiling
β βββ project_utils.py <- For project specific utilities
β β
β βββ text <- Code for dealing with text. Includes distributed loading of text corpus,
β β entity statement extraction, sentiment analysis, pii removal etc.
β βββ __init__.py <- Makes data_science_toolbox a Python module
βββ tests <- Pytest unit tests
βββ dist <- tars and whls of version builds
βββ LICENSE
βββ poetry.lock
βββ pyproject.toml