YuMinHui825

followers

following

stars

shibu's starred repositories

llama.cpp

LLM inference in C/C++

Language:C++MIT6180600

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Language:C++MIT766300

NDKSecurityCore

一种基于NDK级别的安全认证方案

2100

ppl.nn

A primitive library for neural network

Language:C++Apache-2.0125200

nndeploy

nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。

Language:C++Apache-2.054300

Kangaroo

Implementation of Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

Language:Python3400

amx

Apple AMX Instruction Set

Language:CMIT93000

applegpu

Apple G13 GPU architecture docs and tools

Language:HTMLBSD-3-Clause52400

tinygrad

You like pytorch? You like micrograd? You love tinygrad! ❤️

Language:PythonMIT2519000

ml-ane-transformers

Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

Language:PythonNOASSERTION252000

TNN

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

Language:C++NOASSERTION433700

protobuf

Protocol Buffers - Google's data interchange format

Language:C++NOASSERTION6465000

Skywork-MoE

Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models

onnx

Open standard for machine learning interoperability

Language:PythonApache-2.01730000

libuv

Cross-platform asynchronous I/O

Language:CMIT2361600

NVS_Solver

Source code of paper "NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer"

Language:Python20200

coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

Language:PythonBSD-3-Clause423800

DiffSynth-Studio

Enjoy the magic of Diffusion models!

Language:PythonApache-2.0587700

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Language:C++NOASSERTION1978200

MNN

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

Language:C++847400

V-Express

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.

Language:Python206900

FCRN-DepthPrediction

Deeper Depth Prediction with Fully Convolutional Residual Networks (FCRN)

Language:PythonBSD-2-Clause111000

WhisperKit

On-device Speech Recognition for Apple Silicon

Language:SwiftMIT295700

mlx

MLX: An array framework for Apple silicon

Language:C++MIT1580600

Anime4KMetal

Anime4K for Apple platforms based on Metal

Language:SwiftApache-2.09200

LearnMediaCodec

A Android MediaCodec Tutorial

Language:Kotlin1000

skynet

A lightweight online game framework

Language:CMIT1313400

coroutine

A asymmetric coroutine library for C.

Language:CMIT241800

Color-space-conversion

Color space conversion

Language:C++100

REDPlayer

the REDPlayer :)

LGPL-3.0100