ai-infra

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

SpargeAttention: A training-free sparse attention that can accelerate any model inference.

High performance distributed cache system. Built by Rust.

AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识

Transform your pythonic research to an artifact that engineers can deploy easily.

This is a landscape of the infrastructure that powers the generative AI ecosystem

Cloud Native ML/DL Platform

hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等

TME: Structured memory engine for LLM agents to plan, rollback, and reason across multi-step tasks.

Triton multi-level runner, include cubin, ptx, ttgir etc.

vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust

A curated list of awesome tools, frameworks, platforms, and resources for building scalable and efficient AI infrastructure, including distributed training, model serving, MLOps, and deployment.

OriginDL: A distributed deep learning framework Built from scratch

This repository contains a list of various service-specific Azure Landing Zone implementation options.

Triton for OpenCL backend, and use mlir-translate to get source OpenCL code

Memory Management Service, a Long Term Memory Solution for AI

The Lisa programming language.

TME: Structured memory engine for LLM agents to plan, rollback, and reason across multi-step tasks. DAG upgrade in progress.

visualize ai omegacycle

Decenteralized AI training platform for all