csong27

mml-book.github.io

Companion webpage to the book "Mathematics For Machine Learning"

pfl-research

Simulation framework for accelerating research in Private Federated Learning

mlx

MLX: An array framework for Apple silicon

MS-AMP

Microsoft Automatic Mixed Precision Library

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

ggml

Tensor library for machine learning

axlearn

An Extensible Deep Learning Library

llama

Inference code for Llama models

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

starting-kit

Starting kit for the NeurIPS 2023 unlearning challenge

LLMDataHub

A quick guide (especially) for trending instruction finetuning datasets

pycma

Python implementation of CMA-ES

nevergrad

A Python toolbox for performing gradient-free optimization

BayesianOptimization

A Python implementation of global optimization with gaussian processes.

benchmark_bilevel

Benchmark for bi-level optimization solvers

csh

Simple Hierarchical Count Sketch in Python

CommEfficient

PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms

FLSim

Federated Learning Simulator (FLSim) is a flexible, standalone core library that simulates FL settings with a minimal, easy-to-use API. FLSim is domain-agnostic and accommodates many use cases such as vision and text.

ml-flair

A large labelled image dataset for benchmarking in federated learning

Auto-PyTorch

Automatic architecture search and hyperparameter optimization for PyTorch

TCN

Sequence modeling benchmarks and temporal convolutional networks

conversational-datasets

Large datasets for conversational AI

collision-bert

minitorch

The full minitorch student suite.

DiffPruning

Parameter Efficient Transfer Learning with Diff Pruning

Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

TorchPQ

Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda

functorch

functorch is JAX-like composable function transforms for PyTorch.

Pytorch-NCE

The Noise Contrastive Estimation for softmax output written in Pytorch

haste

Haste: a fast, simple, and open RNN library