Gutianpei

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

Scrapegraph-ai

Python scraper based on AI

IC-Light

More relighting!

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

PuLID

Official code for PuLID: Pure and Lightning ID Customization via Contrastive Alignment

whisper-turbo

Cross-Platform, GPU Accelerated Whisper 🏎️

StreamingT2V

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

ComfyUI-to-Python-Extension

A powerful tool that translates ComfyUI workflows into executable Python code.

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

PhysDreamer

Code for PhysDreamer

CameraCtrl

T-GATE

T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!

ComfyUI-IC-Light-Wrapper

Wraps the IC-Light Diffuser demo to a ComfyUI node

HPT

HPT - Open Multimodal LLMs from HyperGAI

CosmicMan

CosmicMan: A Text-to-Image Foundation Model for Humans (CVPR 2024)

B-LoRA

Implicit Style-Content Separation using B-LoRA

zigma

A PyTorch implementation of the paper "ZigMa: A DiT-Style Mamba-based Diffusion Model" (ECCV 2024)

mmdit

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch

InternVideo2

stylus

FreeNoise-AnimateDiff

[ICLR 2024] Code for FreeNoise based on AnimateDiff

LODGE

The code the CVPR2024 paper Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives

Duolando

Code for ICLR 2024 paper "Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment"

LLaVA-PruMerge

LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models

videogigagan-pytorch

Implementation of VideoGigaGAN, SOTA video upsampling out of Adobe AI labs, in Pytorch

VFIPS

The PyTorch implementation for A Perceptual Quality Metric for Video Frame Interpolation

NAE_CVPR2024

Accepted by CVPR 2024

seraena

WIP Pytorch code for stably training single-step, mode-dropping, deterministic autoencoders