leewxgit

herald

Herald: Accelerating Neural Recommendation Training with Embedding Scheduling (NSDI 2024)

srnic-simulation-public

pcm

Intel® Performance Counter Monitor (Intel® PCM)

kineto

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

Hetu

A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, please visit/star/fork https://github.com/PKU-DAIR/Hetu

dlrm

An implementation of a deep learning recommendation model (DLRM)

torchrec

Pytorch domain library for recommendation systems

DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

gpustat

📊 A simple command-line utility for querying and monitoring GPU status

ising-homepage

milvus

A cloud-native vector database, storage for next generation AI applications

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

lingvo

Lingvo

serving

A flexible, high-performance serving system for machine learning models

llama

Inference code for Llama models

Megatron-LM

Ongoing research training transformer models at scale

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

FpgaNIC

FpgaNIC is an FPGA-based Versatile 100Gb SmartNIC for GPUs

astra-sim

ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

lucid

BFC_NS3_NSDI2022

NS3 code for Backpressure Flow Control

SP-PIFO

Approximating Push-In First-Out Behaviors using Strict-Priority Queues

p4-projects

P4 codes for research projects

p4-learning

Compilation of P4 exercises, examples, documentation, slides for learning or teaching

tutorials

P4 language tutorials

Open-Tofino

ATP

iperf

iperf3: A TCP, UDP, and SCTP network bandwidth measurement tool