Maitreyapatel

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

VAR

[NeurIPS 2024 Oral][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

ELLA

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

rcg

PyTorch implementation of RCG https://arxiv.org/abs/2312.03701

sdxs

Official repo of our paper "SDXS: Real-Time One-Step Latent Diffusion Models with Image Conditions"

AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

piecewise-rectified-flow

PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator (NeurIPS 2024)

awesome-text-to-image-studies

A collection of awesome text-to-image generation studies.

Ctrl-Adapter

Official implementation of Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model

MACE

[CVPR 2024] "MACE: Mass Concept Erasure in Diffusion Models" (Official Implementation)

awesome-video-generation

A collection of awesome video generation studies.

LaVi-Bridge

[ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation

hf_transfer

PnPInversion

[ICLR2024] Official repo for paper "PnP Inversion: Boosting Diffusion-based Editing with 3 Lines of Code"

ml-veclip

The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"

VTimeLLM

[CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".

StyleID

[CVPR 2024 Highlight] Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer

Awesome_Long_Form_Video_Understanding

Awesome papers & datasets specifically focused on long-term videos.

TokenCompose

(CVPR 2024) 🧩 TokenCompose: Text-to-Image Diffusion with Token-level Supervision

FreeStyle

FreeStyle : Free Lunch for Text-guided Style Transfer using Diffusion Models

RealCompo

[NeurIPS 2024] RealCompo: Balancing Realism and Compositionality Improves Text-to-Image Diffusion Models

SpLiCE

Sparse Linear Concept Embeddings

unified-io-2.pytorch

Momentor

edit-one-for-all

✏️ Edit One for All: Interactive Batch Image Editing (CVPR 2024)

DAC

Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models

WOUAF

WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models (CVPR 2024)