Repository navigation

#

dags

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Python
1578
21 天前

Dynamically generate Apache Airflow DAGs from YAML configuration files

Python
1277
2 天前

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Python
369
5 天前

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

Python
219
5 天前

A Python 3 package for learning Bayesian Networks (DAGs) from data. Official implementation of the paper "DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization"

Python
115
1 年前

causact: R package to accelerate computational Bayesian inference workflows in R through interactive visualization of models and their output.

R
46
3 个月前

Bayesian inference from binary causal models

R
28
2 个月前

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

Python
23
8 个月前

This provider contains operators, decorators and triggers to send a ray job from an airflow task

Python
18
25 天前

Stop creating bad DAGs! Use this tool to measure and compare the parse time of your DAGs, identify bottlenecks, and optimize your Airflow environment for better performance.

Python
17
2 个月前

This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.

Python
14
14 天前

Use regression, inverse probability weighting, and matching to close confounding backdoors and find causation in observational data

13
5 年前

Airflow plugin to create/edit Dags via drag-and-drop on a convenient UI

JavaScript
12
2 年前

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

Python
12
2 年前

dagrad is a Python package that provides an extensible, modular platform for developing and experimenting with differentiable (gradient-based) structure learning methods.

Python
11
2 个月前

🌱 Concurrently run a set of dependent, asynchronous tasks with type-safe dependencies

TypeScript
9
3 年前

Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.

8
7 个月前

Udacity Data Engineering Nanodegree Capstone Project

Jupyter Notebook
8
5 年前

Projeto final de conclusão do Bootcamp IGTI 2021/1

Python
6
4 年前