HuaZheLei

Fooocus

Focus on prompting and generating

AgentGPT

🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.

ControlNet

Let us control diffusion models!

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

ml-engineering

Machine Learning Engineering Open Book

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

agents

An Open-source Framework for Autonomous Language Agents

IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

NExT-GPT

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

consistencydecoder

Consistency Distilled Diff VAE

modelscope-agent

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

ml-fastvit

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.

ControlNet-for-Diffusers

Transfer the ControlNet with any basemodel in diffusers🔥

AgentSims

AgentSims is an easy-to-use infrastructure for researchers from all disciplines to test the specific capacities they are interested in.

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

tarsier

Vision utilities for web interaction agents 👀

ScaleCrafter

[ICLR 2024 Spotlight] Official implementation of ScaleCrafter for higher-resolution visual generation at inference time.

ControlNet-XS

prompt-pretraining

Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"

COMM

Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models

ai-town-rwkv-proxy

Run a large AI town, locally, via RWKV !

PALI3

Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"

WeMM

AMBER

An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation

Lion

Lion: Kindling Vision Intelligence within Large Language Models

InfMLLM

Q-Bench

An archived version of Q-Bench. We will make updates in https://github.com/q-future/Q-Bench in the future.