github.com/vmware-tanzu/streaming-runtimes

Streaming Runtimes

Overview

Kubernetes' execution environment, designed to simplify the development and the operation of streaming data processing applications. It enables complex data processing scenarios including Time Windowing Aggregation, streaming joins as well as user-defined functions to process the streamed data. Find more.

Try it out

Follow the Installation & Overview instructions.

Explore the architecture documentation to learn about the Streaming Runtime capabilities or jump to the samples to start learning how to build streaming pipeline.

Build & Run

• Streaming Runtime Operator - follow the Streaming Runtime Operator build instructions to build the operator, create a container image and upload it to container registry.
• User Defined Functions - follow the User Defined Function about information how implement and build your own UDF and how to use it from within a Processor resource.

Documentation

Visit the official site of the Streaming Runtimes for documentation.

run documentation locally

We use the docs folder to generate documentation website for this project.

You can build the documentation container image and run it with:

mkdocs serve

This will serve in localhost:8000 the docs site.

Samples & Tutorials

The Streaming Runtime Samples offers a good starting point to start learning how to build streaming pipeline and what are the components involved.

Contributing

The streaming-runtimes project team welcomes contributions from the community. All contributors to this project must have a signed Contributor License Agreement (“CLA”) on file with us. The CLA grants us the permissions we need to use and redistribute your contributions as part of the project; you or your employer retain the copyright to your contribution. Before a PR can pass all required checks, our CLA action will prompt you to accept the agreement. Head over to https://cla.vmware.com/ to see your current agreement(s) on file or to sign a new one.

For more detailed information, refer to CONTRIBUTING.md.