Python module for reading and writing Apache ORC_ file format. It uses the Apache ORC's Core C++ API under the hood, and provides a similar interface as the csv module_ in the Python standard library.

Supports only Python 3.9 or newer and ORC 1.7.

Features

Reading ORC files.
Writing ORC files.
While using Python's stream/file-like object IO interface.

That sums up quite well the purpose of this project.

Example

Minimal example for reading an ORC file:

.. code:: python

    import pyorc

    with open("./data.orc", "rb") as data:
        reader = pyorc.Reader(data)
        for row in reader:
            print(row)

And another for writing one:

.. code:: python

    import pyorc

    with open("./new_data.orc", "wb") as data:
        with pyorc.Writer(data, "struct<col0:int,col1:string>") as writer:
            writer.write((1, "ORC from Python"))

Contribution

Any contributions are welcome. If you would like to help in development fork or report issue here on Github. You can also help in improving the documentation.

.. _Apache ORC: https://orc.apache.org/ .. _csv module: https://docs.python.org/3/library/csv.html

Keywords

python3

orc

apache-orc

FAQs

What is pyorc?

Is pyorc well maintained?

Did you know?

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install