hydra-zen

hydra-zen

A library that facilitates configurable, reproducible, and scalable workflows, using Hydra.

Check out our documentation for more information.

Interested in machine learning? Check out our guide for using PyTorch Lightning with hydra-zen.⚡

hydra-zen is a Python library that simplifies the process of writing code (research-grade or production-grade) that is:

• Configurable: you can configure all aspects of your code from a single interface (the command line or a single Python function).
• Repeatable: each run of your code will be self-documenting; the full configuration of your software is saved alongside your results.
• Scalable: launch multiple runs of your software, be it on your local machine or across multiple nodes on a cluster.

hydra-zen eliminates all hand-written yaml configs from your Hydra project. It does so by providing functions that dynamically and automatically generate dataclass-based configs for your code. It also provides a custom config-store API and task-function wrapper, which help to eliminate most of the Hydra-specific boilerplate from your project.

Learn about hydra-zen at a glance.

Installation

hydra-zen is lightweight: its only dependencies are hydra-core and typing-extensions.

pip install hydra-zen

Contributing

Before opening a PR to this repo, consider posting an issue or a discussion topic to share your ideas with us. We will work with you to ensure your feature is well-scoped and that your hard work goes to good use.

(See an obvious bug or typo? Go ahead and just open a PR :) )

For further details refer to these docs.

Join the Discussion

Share ideas, ask questions, and chat with us over at hydra-zen's discussion board.

Citation

Using hydra-zen for your research? Please cite the following publication:

@article{soklaski2022tools,
  title={Tools and Practices for Responsible AI Engineering},
  author={Soklaski, Ryan and Goodwin, Justin and Brown, Olivia and Yee, Michael and Matterer, Jason},
  journal={arXiv preprint arXiv:2201.05647},
  year={2022}
}

Disclaimer

DISTRIBUTION STATEMENT A. Approved for public release: distribution unlimited.

© 2024 MASSACHUSETTS INSTITUTE OF TECHNOLOGY

Subject to FAR 52.227-11 – Patent Rights – Ownership by the Contractor (May 2014)
SPDX-License-Identifier: MIT

This material is based upon work supported by the Under Secretary of Defense for Research and Engineering under Air Force Contract No. FA8702-15-D-0001. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Under Secretary of Defense for Research and Engineering.

A portion of this research was sponsored by the United States Air Force Research Laboratory and the United States Air Force Artificial Intelligence Accelerator and was accomplished under Cooperative Agreement Number FA8750-19-2-1000. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the United States Air Force or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein.

The software/firmware is provided to you on an As-Is basis