Repository navigation
data-platform
- Website
- Wikipedia
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
Open data platform based on Kubernetes. Scaleph supports SeaTunnel、Flink and Doris backended by SeaTunnel on Flink engine、Flink Kubernetes Operator and Doris operator.
A curated list of open source tools used in analytics platforms and data engineering ecosystem
TechUI is a easy to use Dynamic SVG Data Visualization Dashboard development tool, based on vite + vue2 development
Serverless multi-protocol + multi-destination event collection system.
KDP(Kubernetes Data Platform) delivers a modern, hybrid and cloud-native data platform based on Kubernetes.
source{d} Community Edition (CE)
Template to deploy the Data Management Zone of Cloud Scale Analytics (former Enterprise-Scale Analytics). The Data Management Zone provides data governance and management capabilities for the data platform of an organization.
Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Landing Zone is a logical construct and a unit of scale in the architecture that enables data retention and execution of data workloads for generating insights and value with data.
ODD Specification is a universal open standard for collecting metadata.
AtroCore is an open-source Data Platform, Data Management and Master Data Management (MDM) software, which can be used to quickly create any business application.
A free, simple, and easy-to-use technology-style UI component, developed based on vue3
python ETL framework
Example repository showing how to build a data platform with Prefect, dbt and Snowflake
Protobuf converter plugin for Kafka Connect
Internet of Things data platform for temperature and humidity sensors with maps
Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to create insights and products for external users.