liangzimei

TaskMatrix

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

open_clip

An open source implementation of CLIP.

Dreambooth-Stable-Diffusion

Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion

Yi

A series of large language models trained from scratch by developers @01-ai

Inpaint-Anything

Inpaint anything using Segment Anything and inpainting models.

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

GroundingDINO

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

GPT-4-LLM

Instruction Tuning with GPT-4

stablediffusion-infinity

Outpainting with Stable Diffusion on an infinite canvas

mPLUG-Owl

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

CoOp

Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)

Multimodal-GPT

Multimodal-GPT

unidiffuser

Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"

DDNM

[ICLR 2023 Oral] Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model

VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列

VideoX

VideoX: a collection of video cross-modal models

MAT

MAT: Mask-Aware Transformer for Large Hole Image Inpainting

X-LLM

X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages

Youku-mPLUG

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

ICLRec

protoclip

📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)

MIC

MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU