prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

🦾 Take control of your AI agents

🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub

The Prefect API and backend

A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.

The home of the Prefect 1 UI

A simple guide to understand Prefect and make it work with your own docker-compose configuration.

Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate

Code examples showing flow deployment to various types of infrastructure

Tools for using Langchain with Prefect

Example repository showing how to build a data platform with Prefect, dbt and Snowflake

Prefect integrations with AWS.

Collection of Prefect integrations for working with dbt with your Prefect flows.

Template to quickly bootstrap a Prefect Collection

Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing

Prefect integrations with Ray

Prefect integrations with Google Cloud Platform.

Prefect tasks and subflows for interacting with shell commands.

Pocket data flows orchestrated using Prefect