stdKonjac

stable-diffusion

A latent text-to-image diffusion model

llama

Inference code for Llama models

ChatGPT

🔮 ChatGPT Desktop Application (Mac, Windows and Linux)

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

TaskMatrix

ChatPaper

Use ChatGPT to summarize the arXiv papers. 全流程加速科研，利用chatgpt进行论文全文总结+专业翻译+润色+审稿+审稿回复

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

open_clip

An open source implementation of CLIP.

instruct-pix2pix

LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

lm-evaluation-harness

A framework for few-shot evaluation of language models.

SS-SSR-V2ray

机场推荐与机场评测ssr/v2ray2023

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

fairscale

PyTorch extensions for high performance and large scale training.

Emu

Emu Series: Generative Multimodal Models from BAAI

LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

SEED

Official implementation of SEED-LLaMA (ICLR 2024).

XPretrain

Multi-modality pre-training

flip

Official Open Source code for "Scaling Language-Image Pre-training via Masking"

model-soups

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

P5

SEED-Bench

(CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.

unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

ICCV23-IDPT

The code for the paper "Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models" (ICCV'23).

HBI

[CVPR 2023 Highlight] Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning

VindLU

STAN

Official PyTorch implementation of the paper "Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring"

Recformer

Codebase for KDD 2023 paper, Text Is All You Need: Learning Language Representations for Sequential Recommendation