npu

Tengine is a lite, high performance, modular inference engine for embedded device

Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

An MLIR-based toolchain for AMD AI Engine-enabled devices.

Efficient Inference of Transformer models

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

No-code CLI designed for accelerating ONNX workflows

Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs

FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference

hardware design of universal NPU(CNN accelerator) for various convolution neural network

ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference

High-speed and easy-use LLM serving framework for local deployment

YoloV5 NPU for the RK3566/68/88

An interactive Ascend-NPU process viewer

C/C++ development kit for Sipeed Maix ecosystem boards

YoloV8 NPU for the RK3566/68/88

Simplified AI runtime integration for mobile app development