mlops

A high-throughput and memory-efficient inference and serving engine for LLMs

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Label Studio is a multi-type data labeling and annotation tool with standardized output format

☁️ Build multimodal AI applications with cloud-native stack

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Turns Data and AI algorithms into production-ready web applications in no time.

Workflow Engine for Kubernetes

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Machine Learning Engineering Open Book

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

A curated list of references for MLOps

An orchestration platform for the development, production, and observation of data assets.

Free MLOps course from DataTalks.Club

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Always know what to expect from your data.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.