longcw

ColossalAI

Making large AI models cheaper, faster and more accessible

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

TaskMatrix

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Wav2Lip

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

open_clip

An open source implementation of CLIP.

kohya_ss

search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

GroundingDINO

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

MiniCPM

MiniCPM-2B: An end-side LLM outperforms Llama2-13B.

AnyDoor

Official implementations for paper: Anydoor: zero-shot object-level image customization

img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

T2I-Adapter

T2I-Adapter

EditAnything

Edit anything in images powered by segment-anything, ControlNet, StableDiffusion, etc. (ACM MM)

promptfoo

Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.

TokenFlow

Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)

CVinW_Readings

A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''

Osprey

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

MVDream

Multi-view Diffusion for 3D Generation

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

gaussian-grouping

Gaussian Grouping for open-world Anything reconstruction, segmentation and editing.

MVDream-threestudio

3D generation code for MVDream

multimodal-garment-designer

This is the official repository for the paper "Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing". ICCV 2023

OmniLMM

Large Multi-modal Models for Strong Performance and Efficient Deployment

laion-datasets

Description and pointers of laion datasets