dag-scheduling

A self-contained workflow engine that requires no external database or queues. It aims to be an ideal choice for teams that find Airflow to be overkill and are looking for a simpler solution.

可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)

FaaSFlow: Enable Efficient Workflow Execution for Function-as-a-Service

HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling

A lightweight framework that enables serverless users to reduce their bills by harvesting non-serverless compute resources such as their VMs, on-premise servers, or personal computers.

Simple template DAG scheduler in c++

A kubernetes native workflow orchestrator used to create DAGs that can run on a schedule as well as in an event driven manner

This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.

This project implements a full-stack data engineering solution that connects to the Spotify Web API to extract a user’s recently played tracks, stores the data in a PostgreSQL database, applies transformations using dbt, and delivers actionable insights via Metabase dashboards.

KMM: parallel dataflow scheduler and efficient memory management for multi-GPU platforms

A Deterministic Model to Predict Execution Time of Spark Applications (Query-64 of TPC-DS)