wwcai-intellif

geektime-books

:books: 极客时间电子书

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

alpa

Training and serving large-scale neural networks with auto parallelization.

oneflow

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

tpu-mlir

Machine learning compiler based on MLIR for Sophgo TPU.

ymir

YMIR, a streamlined model development product.

tvm

TVM integration into PyTorch

Halide

a language for fast, portable data-parallel computation

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

glow

Compiler for Neural Network hardware accelerators

mlir

"Multi-Level Intermediate Representation" Compiler Infrastructure

netron

Visualizer for neural network, deep learning and machine learning models

nnvm

caffe

Caffe: a fast open framework for deep learning.

tensorflow

An Open Source Machine Learning Framework for Everyone

linux

Linux kernel source tree