nzl-thu

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

generative-models

Generative Models by Stability AI

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

StableLM

StableLM: Stability AI Language Models

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

IF

mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)

open_flamingo

An open-source framework for training large multimodal models.

Alpaca-CoT

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

Painter

Painter & SegGPT Series: Vision Foundation Models from BAAI

s4

Structured state space sequence models

mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

Caption-Anything

Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything

Emu

Emu Series: Generative Multimodal Models from BAAI

Dromedary

Dromedary: towards helpful, ethical and reliable LLMs.

VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列

Agent-Attention

Official repository of Agent Attention (ECCV2024)

FLatten-Transformer

Official repository of FLatten Transformer (ICCV2023)

open-muse

Open reproduction of MUSE for fast text2image generation.

Smooth-Diffusion

Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Models arXiv 2023 / CVPR 2024

LLaVA-UHD

LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images

open-diffusion

Simple large-scale training of stable diffusion with multi-node support.

MUSE-Pytorch

An in-context conditioning version of MUSE with pre-trained checkpoints.

ARC

[ICCV 2023] Adaptive Rotated Convolution for Rotated Object Detection

Rank-DETR

[NeurIPS 2023] Rank-DETR for High Quality Object Detection

LAUDNet

[IEEE TPAMI] Latency-aware Unified Dynamic Networks for Efficient Image Recognition

Dynamic_Perceiver

Official implementation of Dynamic Perceiver

FamO2O

Repository of "Train Once, Get a Family: State-Adaptive Balances for Offline-to-Online Reinforcement Learning" (NeurIPS 2023 Spotlight)

SEEM

Official code of paper Understanding, Predicting and Better Resolving Q-Value Divergence in Offline-RL