npu

There are 8 repositories under npu topic.

OAID / Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
arm machine-learning artificial-intelligence cnn tensorflow pytorch onnx x86-64 mips cuda tensorrt acl npu riscv supperedge container nvdla
Language:C++ 4590
usefulsensors / useful-transformers
Efficient Inference of Transformer models
cpp neural-networks npu openai-whisper rockchip transformer-models
Language:C++ 341
embedeep / Free-TPU
Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.
free tpu npu cnn-accelerator zynq fpga lstm pytorch rnn npu-compiler caffe darknet deep-learning hardware
Language:Shell 233
AXERA-TECH / ax-samples
Samples code for world class Artificial Intelligence SoCs for computer vision applications.
arm artificial-intelligence axera neural-network npu onnx yolov10 yolov5 yolov6 yolov8
Language:CMake 198
YuzukiHD / TinyVision
TinyVision - A Tiny Linux Board / IPC / Server / Router / And so on...
cv npu opencv oshw sbc v851s
144
AXERA-TECH / ax-pipeline
The Pipeline example based on AXear-Pi (AX620A) , AXera-Pi Pro (AX650N) and AXera-Pi Zero (AX620Q) shows the software development skills of ISP, Image Processing, NPU, Encoding, and Display modules, which is helpful for users to develop their own multimedia applications.
arm codec isp media npu onnx rtsp yolov5
Language:CMake 114
embedeep / FREE-TPU-V3plus-for-FPGA
FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference
accelerator ai npu npu-compiler tpu tpu-acceleration transformer ai-processor zynq transformer-accelerator ai-compiler caffe fpga lstm pytorch
Language:V 95
Qengineering / YoloV5-NPU
YoloV5 NPU for the RK3566/68/88
deep-learning npu orange-pi-5 radxa-zero-3-npu radxa-zero-3w rk3566 rk3568 rk3588 rk3588s rknpu rock-5 rock5c yolov5 yolov5s
Language:C++ 63
Pelochus / ezrknpu
Easy usage of Rockchip's NPUs found in RK3588 and similar chips
llm neural-networks npu rk3588 rockchip
Language:Shell 56
neuralize-ai / edgerunner
Simplified AI runtime integration for mobile app development
android coreml cross-platform gpu inference ios mobile npu on-device-ai qnn tflite cplusplus neural-network
Language:C++ 51
larrylart / codrive
Advanced driver-assistance system with Google Coral Edge TPU Dev Board / USB Accelerator, Intel Movidius NCS (neural compute stick), Myriad 2/X VPU, Gyrfalcon 2801 Neural Accelerator, NVIDIA Jetson Nano and Khadas VIM3
google-coral edge-tpu intel-movidius ncs myriad gyrfalcon 2801 neural-accelerator vim3 amlogic npu nvidia jetson-nano
Language:C 44
thousrm / universal_NPU-CNN_accelerator
hardware design of universal NPU(CNN accelerator) for various convolution neural network
cnn hardware-design npu verilog cnn-accelerator asic-design
Language:Verilog 42
Pelochus / ezrknn-llm
Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series
ai linux llm npu rk3588 rockchip
Language:C 38
thnak / yolov7-rknn
Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).
npu object-detection rk3562 rk3566 rk3568 rk3588 rk3588s rknn rockchip rv1103 rv1106 yolov7
Language:Python 38
neuralize-ai / edgerunner-android
Kotlin bindings for Edgerunner
android inference mobile neural-network npu on-device-ai qnn tflite
Language:Kotlin 26
PSAL-POSTECH / ONNXim
ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference
npu simulator onnx pytorch
Language:C++ 22
ProjectYosemite
YuzukiHD / ProjectYosemite
Small Heterogeneous & AI Powered Computing SBC Based on V853
allwinner-soc npu allwinner-v853 intelligent-vision cv vision cortex cortex-a7 e907
Language:C++ 17
Qengineering / YoloV8-NPU
YoloV8 NPU for the RK3566/68/88
deep-learning npu orange-pi-5 radxa-zero-3-npu radxa-zero-3w rk3566 rk3568 rk3588 rknpu2 rock-5 yolov8 yolov8n rock5c
Language:C++ 16
fateshelled / rknpu2_ros
ROS 2 Inference sample for using Rockchip NPU.
cpp deeplearning npu rockchip ros2
Language:C++ 15
Qengineering / Rock-5-Ubuntu-22-image
Rock Pi 5 image with Ubuntu 22, OpenCV, deep learning frameworks and NPU drivers
ncnn ncnn-framework npu opencv rknpu2 rock-5 rock-pi-5 ubuntu22
10
Qengineering / YoloV8-seg-NPU
YoloV8 segmentation NPU for the RK 3566/68/88
deep-learning npu radxa-zero-3 radxa-zero-3-npu rknpu2 rock-5 yolov8-segmentation
Language:C++ 10
yonseicasl / NPUsim
NPUsim: Full-system, Cycle-accurate, Value-aware NPU Simulator
acceleration accelerator architecture cycle-accurate deep-learning deep-neural-network full-system hardware-accelerator hierarchy machine-learning memory model modeling npu simulator functional-simulation timing-simulation value-aware
Language:C++ 10
av1d / rk3588_npu_llm_server
Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.
llm npu rk3588 rknn-llm
Language:C++ 9
Qengineering / Radxa-Zero-3-NPU-Ubuntu22
Radxa Zero 3W/E image with Ubuntu 22, OpenCV, deep learning frameworks and NPU drivers
ncnn npu opencv radxa-zero-3e radxa-zero-3w radxa-zero3 radxa-zero3-npu radxa-zero3w rk3566 rknpu-model-zoo rknpu2 ubuntu22
9
av1d / NPU-Chat
Web chat front end for rk3588_npu_llm_server / RK3588 LLM chat interface
llm npu rk3588 rknn rockchip rk-llm
Language:CSS 8
marty1885 / rknn-superresolution
Superresolution running on Rockchip NPU (RK3588, etc..)
npu rk3588 rknn rockchip super-resolution
Language:Python 8
EmbeddedLLM / embeddedllm
EmbeddedLLM: API server for Embedded Device Deployment. Currently support IpexLLM/DirectML./CPU
llm llm-inference directml directx-12 gemma llama mistral phi-3 llm-serving model-inference open-source-llm aipc npu windows ipexllm cpu
Language:Python 7
marty1885 / scirknn
Convert and run scikit-learn MLPs on Rockchip NPU.
npu rknn rknpu2 rockchip scikit-learn rk3566 rk3588 inference-acceleration
Language:Python 7
Pelochus / ezrknn-toolkit2
Making Rockchip's RKNN-Toolkit-2 install easier for SBCs like Orange Pi 5 or Radxa Rock 5
ai linux npu rk3588 rockchip neural-networks
Language:C 7
Qengineering / Rock-5-image
Rock Pi 5 image with OpenCV, deep learning frameworks and NPU drivers
debian11 ncnn npu opencv rknpu2 rock-pi-5 tnn
7
tpoisonooo / deploee-benchmark
硬件模型库芯片评测
armv7 ax620a benchmark deep-learning neon npu
Language:Python 6
Qengineering / YoloV10-NPU
YoloV10 NPU for the RK3566/68/88
deep-learning npu orange-pi-5 radxa-zero-3-npu radxa-zero-3w rk3566 rk3568 rk3588 rknn-model rknpu2 rock5c yolov10
Language:C++ 5
rknpu-exporter
yinguobing / rknpu-exporter
Prometheus exporter for Rockchip NPU load metrics, written in Rust.
exporter npu prometheus rockchip
Language:Rust 5
mpskex / chisel-npu
Chisel implementation of Neural Processing Unit for System on the Chip
chisel3 npu processor-design system-on-chip
Language:Scala 4
Qengineering / YoloV5-seg-NPU
YoloV5 segmentation NPU for the RK 3566/68/88
deep-learning npu orange-pi-5 radxa-zero-3-npu radxa-zero-3w rk3566 rk3568 rk3588 rknpu2 rock-5
Language:C++ 4
selimsandal / OneShotNPU
An NPU designed using an LLM with a single prompt
ai digital-design llm npu
Language:Verilog 4

npu

OAID / Tengine

usefulsensors / useful-transformers

embedeep / Free-TPU

AXERA-TECH / ax-samples

YuzukiHD / TinyVision

AXERA-TECH / ax-pipeline

embedeep / FREE-TPU-V3plus-for-FPGA

Qengineering / YoloV5-NPU

Pelochus / ezrknpu

neuralize-ai / edgerunner

larrylart / codrive

thousrm / universal_NPU-CNN_accelerator

Pelochus / ezrknn-llm

thnak / yolov7-rknn

neuralize-ai / edgerunner-android

PSAL-POSTECH / ONNXim

YuzukiHD / ProjectYosemite

Qengineering / YoloV8-NPU

fateshelled / rknpu2_ros

Qengineering / Rock-5-Ubuntu-22-image

Qengineering / YoloV8-seg-NPU

yonseicasl / NPUsim

av1d / rk3588_npu_llm_server

Qengineering / Radxa-Zero-3-NPU-Ubuntu22

av1d / NPU-Chat

marty1885 / rknn-superresolution

EmbeddedLLM / embeddedllm

marty1885 / scirknn

Pelochus / ezrknn-toolkit2

Qengineering / Rock-5-image

tpoisonooo / deploee-benchmark

Qengineering / YoloV10-NPU

yinguobing / rknpu-exporter

mpskex / chisel-npu

Qengineering / YoloV5-seg-NPU

selimsandal / OneShotNPU