Repository navigation

pipeline-testing

Website
Wikipedia

Always know what to expect from your data.

pipeline-tests dataquality datacleaning datacleaner 数据科学 data-profiling pipeline pipeline-testing cleandata dataunittest eda exploratory-data-analysis data-quality data-engineering mlops

Python

10335

1571

16 小时前

sodadata / soda-core

⚡ Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io

Python data-engineering data-governance data-monitoring data-observability data-profiling data-quality data-quality-checks data-quality-monitoring data-reliability data-testing data-validation dataquality dbt pipeline-testing snowflake data-contracts

Python

2066

231

1 天前

IBM / lale

Library for Semi-Automated Data Science

scikit-learn automl automated-machine-learning hyperparameter-optimization hyperparameter-tuning hyperparameter-search Python 人工智能 pipeline-tests pipeline-testing dataquality 数据科学机器学习 interoperability

Python

335

12 天前

sodadata / soda-github-action

⚡ Prevent downstream data quality issues by integrating the Soda Library into your CI/CD pipeline.

data-engineering data-monitoring data-observability data-quality data-quality-checks data-quality-monitoring data-reliability data-testing data-validation dataquality pipeline-testing snowflake

Python

7 个月前

jibbs1703 / Energy-Data-Pipeline

This repository contains an ETL pipeline that collects monthly electricity price and demand data by region in Australia. The source files are in CSV format and contain energy price and demand data at 30-minute intervals.

asynchronous-programming data-engineering data-ingestion data-transfer etl-pipeline pipeline-testing

3 个月前