jiasenlu

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

instant-ngp

Instant neural graphics primitives: lightning fast NeRF and more

gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

faster-rcnn.pytorch

A faster pytorch implementation of faster r-cnn

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

OLMo

Modeling, training, eval, and inference code for OLMo

riffusion

Stable diffusion for real-time music generation

Kandinsky-2

Kandinsky 2 — multilingual text2image latent diffusion model

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

hifi-gan

HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

ast

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

train-CLIP

A PyTorch Lightning solution to training OpenAI's CLIP from scratch.

unified-io-2

seqio

Task-based datasets, preprocessing, and evaluation for sequence models.

oie-resources

A curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.

lightning-sam

Fine-tune Segment-Anything Model with Lightning Fabric.

DALLE-mtf

Open-AI's DALL-E for large scale training in mesh-tensorflow.

pixel-cnn-pp

Pytorch Implementation of OpenAI's PixelCNN++

SpecVQGAN

Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)

DDPM_inversion

Official pytorch implementation of the paper: "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". CVPR 2024.

unified-io-inference

soho

[CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Unofficial-Pix2Seq

Unofficial implementation of Pix2SEQ

DCNv2

Deformable Convolutional Networks v2 with Pytorch

hifigan

An 16kHz implementation of HiFi-GAN for soft-vc.

lmconv

Code for UAI 2020 paper "Locally Masked Convolution for Autoregressive Models"

Diff-DALLE

unified-io-2.pytorch

tf-invertible-resnet

A TensorFlow implementation of Invertible Residual Networks