npu

Tengine is a lite, high performance, modular inference engine for embedded device

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

An MLIR-based toolchain for AMD AI Engine-enabled devices.

Efficient Inference of Transformer models

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

No-code CLI designed for accelerating ONNX workflows

Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs

FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference

ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference

hardware design of universal NPU(CNN accelerator) for various convolution neural network

Run LLMs on AMD Ryzen™ AI NPUs. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

High-speed and easy-use LLM serving framework for local deployment

An interactive Ascend-NPU process viewer

YoloV5 NPU for the RK3566/68/88

C/C++ development kit for Sipeed Maix ecosystem boards

YoloV8 NPU for the RK3566/68/88

Simplified AI runtime integration for mobile app development