TianheWu

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

VideoWatermarking

LeetcodeTop

汇总各大互联网公司容易考察的高频leetcode题🔥

Q-Ground

Official codes for "Q-Ground: Image Quality Grounding with Large Multi-modality Models", ACM MM2024 (Oral)

LLaVA-NeXT

MEFNet

Official Implementation of MEF-Net

3dpe

[ECCV 2024] 3DPE: Real-time 3D-aware Portrait Editing from a Single Image

open_clip

An open source implementation of CLIP.

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

HiDiffusion

[ECCV 2024] HiDiffusion: Increases the resolution and speed of your diffusion model by only adding a single line of code!

CoSeR

An unofficial implementation for "CoSeR: Bridging Image and Language for Cognitive Super-Resolution (CVPR 2024)"

Awesome-High-Resolution-Diffusion

🔥🔥🔥A curated list of papers on recent diffusion-based high-resolution image and video synthesis works.

ResMaster

cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

CVPR-2024-Papers

StyleCrafter-SDXL

Code of StyleCrafter on SDXL

LM4LV

🔥Official PyTorch implementation for "LM4LV: A Frozen Large Language Model for Low-level Vision Tasks".

Diff-Plugin

[CVPR 2024] Official code release of our paper "Diff-Plugin: Revitalizing Details for Diffusion-based Low-level tasks"

stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

CaD-VI

Comparison Visual Instruction Tuning (CaD-VI)

ChartMimic

ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation

Open-MAGVIT2

Open-MAGVIT2: Democratizing Autoregressive Visual Generation

OSEDiff

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

HunyuanDiT

Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding

MMDialog

The official site of paper MMDialog: A Large-scale Multi-turn Dialogue Dataset Towards Multi-modal Open-domain Conversation

CCSR

Official codes of CCSR: Improving the Stability of Diffusion Models for Content Consistent Super-Resolution

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

HDC

The official implementation of Hierarchical Semantic Decoding with Counting Assitance for Generalized Referring Expression Segmentation