ClashLuke

TrueGrad

PyTorch interface for TrueGrad Optimizers

tpucare

Automatically take good care of your preemptible TPUs

PerfTorch

High performance pytorch modules

MinRETRO

Reimplementation of `Improving language models by retrieving from trillions of tokens`

gpt3-discord-bot

Adaptive-Gradient-Clipping

named_treemap

pytorch-lmu

A PyTorch implementation of Legendre Memory Units (LMUs) and it's FFT variant

SharedUtils

Easy usage of Python's new SharedMemory for reduced memory and CPU cost

sharpened_cosine_similarity_torch

A Sharpened Cosine Similarity layer for PyTorch

TTV

WeightStandardization

Standardizing weights to accelerate micro-batch training

AgileRL

Streamlining reinforcement learning with RLOps

algorithmic-efficiency

backpack-hf

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.

HomebrewNLP

Train GPT-3 at home by combining the latest research with custom innovations.

HomebrewNLP-MTF

HomebrewNLP in Mesh-TensorFlow flavour for distributed TPU training

Huawei-Bootloader-Unlocker

This little tool let you unlock your bootloader of your huawei family device easily

jaxhelper

librispeech_100_jax

locoprop-torch

LocoProp implementation in PyTorch. (https://proceedings.mlr.press/v151/amid22a/amid22a.pdf)

memory-transformer-pt4

omninet-pytorch

Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch

pylines

Simplifying parsing of large jsonline files in NLP Workflows

pytorch-center-loss

Pytorch implementation of Center Loss

pytorch-image-models

PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more

pytorch-summary

Model summary in PyTorch similar to `model.summary()` in Keras

rgn2-replica

Replication attempt for the Protein Folding Model described in https://www.biorxiv.org/content/10.1101/2021.08.02.454840v1

tpunicorn

Babysit your preemptible TPUs

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.