lukas-blecher

stable-diffusion

A latent text-to-image diffusion model

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Wav2Lip

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

nougat

Implementation of Nougat Neural Optical Understanding for Academic Documents

lama

🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022

stylegan3

Official PyTorch implementation of StyleGAN3

guided-diffusion

DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

taming-transformers

Taming Transformers for High-Resolution Image Synthesis

AITemplate

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

SimSwap

An arbitrary face-swapping framework on images and videos with one single trained model!

deit

Official DeiT repository

ArtLine

A Deep Learning based project for creating line art portraits.

galai

Model API for GALACTICA

functorch

functorch is JAX-like composable function transforms for PyTorch.

torchsort

Fast, differentiable sorting and ranking in PyTorch

softmax-splatting

an implementation of softmax splatting for differentiable forward warping using PyTorch

ilvr_adm

ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models (ICCV 2021 Oral)

speck

line art image renderer

math-formula-recognition

Math formula recognition (Images to LaTeX strings)

TransDepth

Code for Transformers Solve Limited Receptive Field for Monocular Depth Prediction

LaTeX-OCR

pix2tex: Using a ViT to convert images of equations into LaTeX code.

formula_gan

Unsupervised Training Data Generation of Handwritten Formulas using Generative Adversarial Networks with Self-Attention