Birgitta is a Python ETL test and schema framework, providing automated tests for pyspark notebooks/recipes.
Birgitta allows doing solid ETL and ML, while still liberally
allowing imperfect notebook code, enabling a
DataOps <https://www.dataopsmanifesto.org> way of
working which is both solid and agile, not killing
Data Scientist flexibility by excessive coding standards in notebooks.
In addition to running recipetests on your local dev machine or on a CI/CD server, there is support for running recipetests as [Dataiku](https://www.dataiku.com] DSS Scenarios.
FAQs
Pyspark and notebook unit testing, especially focused on Dataiku.
We found that birgitta demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security Fundamentals
The Socket Threat Research Team uncovers how threat actors weaponize shell techniques across npm, PyPI, and Go ecosystems to maintain persistence and exfiltrate data.
Security News
At VulnCon 2025, NIST scrapped its NVD consortium plans, admitted it can't keep up with CVEs, and outlined automation efforts amid a mounting backlog.
Product
We redesigned our GitHub PR comments to deliver clear, actionable security insights without adding noise to your workflow.
