Repository navigation
data-engineering
- Website
- Wikipedia
Apache Superset is a Data Visualization and Data Exploration Platform
Learn how to design, develop, deploy and iterate on production-grade ML applications.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Data Engineering Zoomcamp is a free nine-week course that covers the fundamentals of data engineering.
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Turns Data and AI algorithms into production-ready web applications in no time.
The Data Engineering Cookbook
An orchestration platform for the development, production, and observation of data assets.
Roadmap to becoming a data engineer in 2021
Always know what to expect from your data.
🐚 Python-powered shell. Full-featured and cross-platform.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Fancy stream processing made operationally mundane
Real-time event streaming platform. Streaming CDC, stream processing, low-latency serving, and Iceberg management.
Open Source Feature Flagging and A/B Testing Platform
The Open Source Feature Store for AI/ML
The open source ELT framework powered by Apache Arrow