data-infrastructure

Postgres operator creates and manages PostgreSQL clusters running in Kubernetes

Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable completely in-browser, using Pyodide, DuckDB, Pandas, and Plotly, Matplotlib, etc. Build dashboards, reports, and notebooks that run offline, load fast, and share like a document.

Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.

Data transformation framework for AI. Ultra performant, with incremental processing.

Highly available elephant herd: HA PostgreSQL cluster using Docker

TensorBase is a new big data warehousing with modern efforts.

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

A battle-tested, flexible & comprehensive monitoring solution for your PostgreSQL databases

Python function to stream unzip all the files in a ZIP archive on the fly

Python writable virtual filesystem for SQLite on S3

Python server to on-the-fly extract and serve vector tiles from an mbtiles file on S3

Python function to construct a ZIP archive on the fly

The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย

JSON schema parser for Apache Spark

Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.

Continuously sync folder to S3, using inotify under the hood

Spawns JupyterHub single user servers in Docker containers running in AWS Fargate

An open source data analysis platform with features for users with a range of technical skills

Python utility function to ingest data into a SQLAlchemy-defined PostgreSQL table

A DNS proxy server that conditionally rewrites and filters A record requests