againcui

MuseTalk

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的可商用开源多模态对话模型

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

llama

Inference code for Llama models

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

vstar

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"

algorithm-visualizer

:fireworks:Interactive Online Platform that Visualizes Algorithms from Code

shikra

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

recognize-anything

Open-source and strong foundation image recognition models.

fMRI-reconstruction-NSD

fMRI-to-image reconstruction on the NSD dataset.

lvis-api

Python API for LVIS Dataset

LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

paco

This repo contains documentation and code needed to use PACO dataset: data loaders and training and evaluation scripts for objects, parts, and attributes prediction models, query evaluation scripts, and visualization notebooks.

MedSAM

Segment Anything in Medical Images

VLPart

[ICCV2023] VLPart: Going Denser with Open-Vocabulary Part Segmentation

OpenPSG

Benchmarking Panoptic Scene Graph Generation (PSG), ECCV'22

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

grounded-segment-any-parts

Grounded Segment Anything: From Objects to Parts

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

RelateAnything

Relate Anything Model is capable of taking an image as input and utilizing SAM to identify the corresponding mask within the image.

XrayGLM

🩺 首个会看胸部X光片的中文多模态医学大模型 | The first Chinese Medical Multimodal Model that Chest Radiographs Summarization.

MedCLIP

EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

XrayGPT

[BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.