pkuanjie

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

generative-models

Generative Models by Stability AI

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

PyTorch-GAN

PyTorch implementations of Generative Adversarial Networks.

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

Awesome-Diffusion-Models

A collection of resources and papers on Diffusion Models

Tune-A-Video

[ICCV 2023] Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

sd-forge-layerdiffuse

[WIP] Layer Diffusion for WebUI (via Forge)

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

awesome-tips

Awesome-Visual-Transformer

Collect some papers about transformer with vision. Awesome Transformer with Computer Vision (CV)

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

CogView

Text-to-Image generation. The repo for NeurIPS 2021 paper "CogView: Mastering Text-to-Image Generation via Transformers".

Emu

Emu Series: Generative Multimodal Models from BAAI

PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

LAMA

LAnguage Model Analysis

video-diffusion-pytorch

Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

Awesome-LLMs-for-Video-Understanding

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

LibFewShot

LibFewShot: A Comprehensive Library for Few-shot Learning. TPAMI 2023.

MotionDiffuse

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model

ClipBERT

[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.

xlnet-Pytorch

Simple XLNet implementation with Pytorch Wrapper

unified-io-2

remi

"Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions", ACM Multimedia 2020

LVDM

LVDM: Latent Video Diffusion Models for High-Fidelity Long Video Generation

VQ-Diffusion

LLaVA-RLHF

Aligning LMMs with Factually Augmented RLHF

AlignProp

AlignProp uses direct reward backpropogation for the alignment of large-scale text-to-image diffusion models. Our method is 25x more sample and compute efficient than reinforcement learning methods (PPO) for finetuning Stable Diffusion

ConsistI2V

ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation (TMLR 2024)

d3po

[CVPR 2024] Code for the paper "Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model"