Yuuraa

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

TaskMatrix

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

fiftyone

The open-source tool for building high-quality datasets and computer vision models

ai-collection

The Generative AI Landscape - A Collection of Awesome Generative AI Applications

lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

Voyager

An Open-Ended Embodied Agent with Large Language Models

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

CoCa-pytorch

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

Awesome-LLMs-for-Video-Understanding

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

Awesome_Prompting_Papers_in_Computer_Vision

A curated list of prompt-based paper in computer vision and vision-language learning.

plug-and-play

Official Pytorch Implementation for “Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation” (CVPR 2023)

Everything-LLMs-And-Robotics

The world's largest GitHub Repository for LLMs + Robotics

x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent papers

actionformer_release

Code release for ActionFormer (ECCV 2022)

flaxformer

ALLaVA

Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model

TVRetrieval

[ECCV 2020] PyTorch code for XML on TVRetrieval dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval

BIKE

【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

VidIL

Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

VindLU

LLaVA-Hound-DPO

GVRT

[ECCV-2022]Grounding Visual Representations with Texts for Domain Generalization