leewxgit

llama

Inference code for Llama models

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

milvus

A cloud-native vector database, storage for next generation AI applications

DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

Megatron-LM

Ongoing research training transformer models at scale

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

iperf

iperf3: A TCP, UDP, and SCTP network bandwidth measurement tool

serving

A flexible, high-performance serving system for machine learning models

gpustat

📊 A simple command-line utility for querying and monitoring GPU status

dlrm

An implementation of a deep learning recommendation model (DLRM)

lingvo

Lingvo

pcm

Intel® Performance Counter Monitor (Intel® PCM)

torchrec

Pytorch domain library for recommendation systems

tutorials

P4 language tutorials

kineto

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

perftest

Infiniband Verbs Performance Tests

p4-learning

Compilation of P4 exercises, examples, documentation, slides for learning or teaching

Open-Tofino

astra-sim

ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

p4-projects

P4 codes for research projects

FpgaNIC

FpgaNIC is an FPGA-based Versatile 100Gb SmartNIC for GPUs

Hetu

A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, please visit/star/fork https://github.com/PKU-DAIR/Hetu

ATP

SP-PIFO

Approximating Push-In First-Out Behaviors using Strict-Priority Queues

lucid

Machine-Learning-on-Cache-Replacement-Policy

CSC2515 Course Project Fall 2018

BFC_NS3_NSDI2022

NS3 code for Backpressure Flow Control

ising-homepage