data-streaming

Apache Kafka® running on Kubernetes

Memphis.dev is a highly scalable and effortless data streaming platform

Apache InLong - a one-stop, full-scenario integration framework for massive data

An extensible distributed system for reliable nearline data streaming at scale

Low-code tool for automating actions on real time data | Stream processing for the users.

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Adapter for dbt that executes dbt pipelines on Apache Flink

DagsHub client libraries

A Python library for machine-learning and feedback loops on streaming data

Sample Applications for Pravega.

Sample code that shows the important aspects of developing custom connectors for Kafka Connect. It provides the resources for building, deploying, and running the code on-premises using Docker, as well as running the code in the cloud.

Strimzi canary

Apache Flink (Pyflink) and Related Projects

High-performance and efficient Framework and Agent for creating data pipelines. The core of pipeline descriptions is based on the Configuration As Code concept and the Pkl configuration language by Apple.

Apache Kafka and Related Projects

Udacity Data Streaming Nanodegree Program

A library for data streaming and augmentation

Kafka Connector for Apache Doris

This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power BI.

A Federated Learning Method for Real-time Emotion State Classification from Multi-modal Streaming