xvjiarui

gpt4all

gpt4all: run open-source LLMs anywhere

ColossalAI

Making large AI models cheaper, faster and more accessible

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

nebuly

The user analytics platform for LLMs

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

instruct-pix2pix

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Tune-A-Video

[ICCV 2023] Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

open_flamingo

An open-source framework for training large multimodal models.

torchscale

Foundation Architecture for (M)LLMs

prompt-to-prompt

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

weak-to-strong

X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language

CrossAttentionControl

Unofficial implementation of "Prompt-to-Prompt Image Editing with Cross Attention Control" with Stable Diffusion

coyo-dataset

COYO-700M: Large-scale Image-Text Pair Dataset

lovely-tensors

Tensors, ready for human consumption

pix2pix-zero

Zero-shot Image-to-Image Translation [SIGGRAPH 2023]

ODISE

Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]

long_stable_diffusion

Long-form text-to-images generation, using a pipeline of deep generative models (GPT-3 and Stable Diffusion)

CLIP_benchmark

CLIP-like model evaluation

video2dataset

Easily create large video dataset from video urls

GRiT

GRiT: A Generative Region-to-text Transformer for Object Understanding (https://arxiv.org/abs/2212.00280)

prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)

RAM-multiprocess-dataloader

Demystify RAM Usage in Multi-Process Data Loaders

EISEN