Gy-Lu

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

frp

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

the-algorithm

Source code for Twitter's Recommendation Algorithm

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

paper-reading

深度学习经典、新论文逐段精读

doomemacs

An Emacs framework for the stubborn martian hacker

ChatPaper

Use ChatGPT to summarize the arXiv papers. 全流程加速科研，利用chatgpt进行论文全文总结+专业翻译+润色+审稿+审稿回复

flash-attention

Fast and memory-efficient exact attention

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

Modern-CPP-Programming

Modern C++ Programming Course (C++03/11/14/17/20/23/26)

tiny-gpu

A minimal GPU design in Verilog to learn how GPUs work from the ground up

emacs.d

An Emacs configuration bundle with batteries included

DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

AI-System

System for AI Education Resource.

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

FastFold

Optimizing AlphaFold Training and Inference on GPU Clusters

LLMSpeculativeSampling

Fast inference from large lauguage models via speculative decoding

emacs-gtd

Get Things Done with Emacs

long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

awesome-llm-understanding-mechanism

awesome papers in LLM interpretability

flux

A fast communication-overlapping library for tensor parallelism on GPUs.

awesome-distributed-ml

A curated list of awesome projects and papers for distributed training or inference

CS61A-2020-Fall-Metarials-Mirror

easydist

Automated Parallelization System and Infrastructure for Multiple Ecosystems

Megatron-Kwai

[USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Parallelism

VGC-Damage-Calculator-Chinese

Personal fork of the VGC damage calculator at trainer tower

siu

An FX Graph Analyzer