chwan1016

veScale

A PyTorch Native LLM Training Framework

triton

Development repository for the Triton language and compiler

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

openfold

Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2

benchmarking-gnns

Repository for benchmarking graph neural networks

Bit-GraphBLAS

awesome-AI-system

paper and its code for AI System

ogb

Benchmark datasets, data loaders, and evaluators for graph machine learning

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

bam

SparseTIR

SparseTIR: Sparse Tensor Compiler for Deep Learning

awesome-neural-rendering

Resources of Neural Rendering

marius

Large scale graph learning on a single machine.

dsa-framework

Release of stream-specialization software/hardware stack.

awesome-gnn-systems

A list of awesome GNN systems.

Citation_Parser

Automatically citation parsing from Google Scholar and Researchgate for creating Github badges

DepthShrinker

[ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan Fu, Haichuan Yang, Jiayi Yuan, Meng Li, Cheng Wan, Raghuraman Krishnamoorthi, Vikas Chandra, Yingyan Lin

cyberduck

Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

tutorials

PyTorch tutorials.

Awesome-Federated-Learning-on-Graph-and-GNN-papers

Federated learning on graph, especially on graph neural networks (GNNs), knowledge graph, and private GNN.

al-folio

A beautiful, simple, clean, and responsive Jekyll theme for academics

only_train_once

OTOv1-v3, NeurIPS, ICLR, TMLR, DNN Training, Compression, Structured Pruning, Erasing Operators, CNN, Diffusion, LLM

Robust-Scratch-Ticket

[NeurIPS 2021] "Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks" by Yonggan Fu, Qixuan Yu, Yang Zhang, Shang Wu, Xu Ouyang, David Cox, Yingyan Lin

mirror-docker-unified

Infrastructure of SJTUG mirrors

wikipedia2vec

A tool for learning vector representations of words and entities from Wikipedia

markov-painting

Procedural art generation from Markov Chain

gpustat

📊 A simple command-line utility for querying and monitoring GPU status