GarlGuo

CD-GraB

CD-GraB is a distributed gradient balancing framework that aims to find distributed data permutation with provably better convergence guarantees than Distributed Random Reshuffling (D-RR). https://arxiv.org/pdf/2302.00845.pdf.

Quest

Turn-based RPG adventure game implemented in OCaml & Python NumPy (Python codes not uploaded)

LibraryDatacenter

This is my group project for creating a distributed library datacenter on MongoDB, Redis, and Hadoop Distributed File System for Distributed Database Systems course on my study-away program in Tsinghua University

SensitiveSparseZO

amagold

ChocoSGD

Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356

DeblurGAN

Image Deblurring using Generative Adversarial Networks

DeepLearning-500-questions

深度学习500问，以问答形式对常用的概率知识、线性代数、机器学习、深度学习、计算机视觉等热点问题进行阐述，以帮助自己及有需要的读者。 全书分为18个章节，50余万字。由于水平有限，书中不妥之处恳请广大读者批评指正。 未完待续............ 如有意合作，联系scutjy2015@163.com 版权所有，违权必究 Tan 2018.06

GraB

Source code for the GraB paper.

Homophilic_Directed_ScaleFree_Networks

Inequalities in Homophilic Directed ScaleFree Networks

HTorch

MeZO

MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

Optimization_and_Sampling_for_Bayesian_Inference

Adaptive MCMC and CMA-ES Python code

Pathways

PyHessian

PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks

pytorch-optimizer

torch-optimizer -- collection of optimizers for Pytorch

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

ranking_with_slot_constraints

ranking_with_slot_constraints_rebuttal

shogun

Shōgun

shrinkbench

PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.

Statistical-Learning-Methods

Implement Statistical Learning Methods, Li Hang the hard way. 李航《统计学习方法》一书的硬核 Python 实现

text_similarity

Text Similarity

transformers-arithmetic

transformers-language-modeling

Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3

transformers-nlp

Transformer Models in NLP

wentao-homepage