onnxruntime

Open source real-time translation app for Android that runs locally

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

An Engine-Agnostic Deep Learning Framework in Java

🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TRT.

📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

OpenMMLab Model Deployment Framework

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

Local AI API Platform

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

QualityScaler - image/video AI upscaler app

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

Lightweight nudity detection

TTS with kokoro and onnx runtime

Robust realtime face and facial landmark tracking on CPU with Unity integration

Realtime human head pose estimation with ONNXRuntime and OpenCV.

Fast ML inference & training for ONNX models in Rust

多个SVC/TTS的C++推理库

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.