ChrisGao001

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

guava

Google core libraries for Java

netron

Visualizer for neural network, deep learning and machine learning models

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

Sentinel

A powerful flow control component enabling reliability, resilience and monitoring for microservices. (面向云原生微服务的高可用流控防护组件)

chromium

The official GitHub mirror of the Chromium source

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

jemalloc

pkuseg-python

pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

oneTBB

oneAPI Threading Building Blocks (oneTBB)

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

tensorflow

图解tensorflow 源码

vearch

Distributed vector search for AI-native applications

tvm_mlir_learn

compiler learning resources collect.

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

ods

Mission: To provide a high-quality open content data structures textbook that is both mathematically rigorous and provides complete implementations.

onnxmltools

ONNXMLTools enables conversion of models to ONNX

HugeCTR

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training

tf-estimator-tutorials

This repository includes tutorials on how to use the TensorFlow estimator APIs to perform various ML tasks, in a systematic and standardised way

tiny-compiler

A tiny compiler for a language featuring LL(2) with Lexer, Parser, ASM-like codegen and VM. Complex enough to give you a flavour of how the "real" thing works whilst not being a mere toy example

timewheel

时间轮定时器

relax

floyd

A raft consensus implementation that is simply and understandable

awesome-programming-books

计算机领域经典书籍

HierarchicalKV

HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of HierarchicalKV is to store key-value feature-embeddings on high-bandwidth memory (HBM) of GPUs and in host memory. It also can be used as a generic key-value storage.

AdminUi

后台ui大全（有这些你就够了）https://blog.csdn.net/m0_37499059/article/details/80519211

ANet

simple demo for network programming

pilipili

blibili