cjmcv

hpc

Learning and practice of high performance computing (CUDA, Vulkan, OpenCL, OpenMP, TBB, SSE/AVX, NEON, MPI, coroutines, etc. )

deeplearning-paper-notes

Reading notes on deep learning papers---深度学习论文阅读笔记 (2013-2018)

dlex-cnn

DIY - A deep learning framework

patterns

A collection of architectural patterns and design patterns.

ai-infra-notes

Reading notes on the open source code of AI infrastructure (sglang, llm, cutlass, hpc, etc.)

ecas

ECAS is a library for edge AI computing acceleration.

cutlass

CUDA Templates for Linear Algebra Subroutines

lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

mxnet

A fork of apache/incubator-mxnet.

pocket-ai

A Portable Toolkit for deploying Edge AI and HPC (opencl, vulkan, simd, task scheduling)

sglang

SGLang is a fast serving framework for large language models and vision language models.

algorithm

cjmcv

cpy

Notes on calling each other between C and python.

tensorflow

An Open Source Machine Learning Framework for Everyone

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

mlc-llm

Universal LLM Deployment Engine with ML Compilation

relax

tflite_micro

Infrastructure to enable deployment of ML models to low-power resource-constrained embedded targets (including microcontrollers and digital signal processors).

TinyNeuralNetwork

TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs