JulianJuaner

U-ViT

A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".

LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

SEED-X

Multimodal Models in Real World

ID-Animator

evolutionary-model-merge

Official repository of Evolutionary Optimization of Model Merging Recipes

MiraData

Official repo for paper "MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions"

FRESCO

[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Mira

SLM

ComfyUI-Tripo

Custom nodes for using Tripo in ComfyUI.

TripoSR

InstantStyle

InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generation 🔥

SEINE

[ICLR 2024] SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction

ALLaVA

Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model

AnimateDiff

AnimationDiff with train

LivePhoto

Official implementations for paper: LivePhoto: Real Image Animation with Text-guided Motion Control

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Visual-CoT

Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

GeoWizard

[ECCV'24] GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image

StreamingT2V

StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

clarity-upscaler

Clarity AI | AI Image Upscaler & Enhancer - free and open-source Magnific Alternative

M2Chat

pexels-crawler

The web crawler for pexels

HD-VG-130M

The HD-VG-130M Dataset

grok-1

Grok open release

GroupContrast

[CVPR 2024] GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding

stable-diffusion-webui-wd14-tagger

Labeling extension for Automatic1111's Web UI