yucornetto

gpt4free

The official gpt4free repository | various collection of powerful language models

llama

Inference code for Llama models

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

llama_index

LlamaIndex is a data framework for your LLM applications

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

mistral-src

Reference implementation of Mistral AI 7B v0.1 model.

open_flamingo

An open-source framework for training large multimodal models.

Detic

Code release for "Detecting Twenty-thousand Classes using Image-level Supervision".

LVM

Emu

Emu Series: Generative Multimodal Models from BAAI

VideoGPT

mmc4

MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.

shikra

GPT4RoI

GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

lvis-api

Python API for LVIS Dataset

all-seeing

[ICLR 2024] This is the official implementation of the paper "The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World"

open-muse

Open reproduction of MUSE for fast text2image generation.

EDICT

fc-clip

[NeurIPS 2023] This repo contains the code for our paper Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convolutional CLIP

DETA

Detection Transformers with Assignment

3D-TransUNet

This is the official repository for the paper "3D TransUNet: Advancing Medical Image Segmentation through Vision Transformers"

CLIPSelf

[ICLR2024 Spotlight] Code Release of CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction

ViTamin

[CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"

qa-lora

Official PyTorch implementation of QA-LoRA

OmniScient-Model

This repo contains the code for our paper Towards Open-Ended Visual Recognition with Large Language Model

V3Det

kmax-deeplab

a PyTorch re-implementation of ECCV 2022 paper based on Detectron2: k-means mask Transformer.

MaXTron

This repo contains the code for our paper MaXTron: Mask Transformer with Trajectory Attention for Video Panoptic Segmentation