Repository navigation
luigi
- Website
- Wikipedia
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
A web frontend for scheduling Jupyter notebook reports
Content for architecting a data science platform for products using Luigi, Spark & Flask.
An NLP framework for clinical phenotyping. Docker | Python | Solr | OMOP. http://claritynlp.readthedocs.io/en/latest/
A luigi powered analytics / warehouse stack
🐍 🐳 Luigi in Docker - alpine and ubuntu images available
Luigi pipeline to download VoxCeleb(2) audio from YouTube and extract speaker segments
Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.
Migrated to: https://gitlab.com/Oslandia/osm-data-classification
Automated ML pipeline with Python, Docker, Luigi, SciKit-Learn and Pandas to predict wine quality ratings
An SMB editor originally created by M.K.S
A simple project to analyse Malaysian airports - an opportunity to play with tools like Luigi, Docker, and Metabase as part of an end-to-end analytics framework.