Maitreyapatel

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

RL4LMs

A modular RL library to fine-tune language models to human preferences

viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"

CLIP_prefix_caption

Simple image captioning model

CrossAttentionControl

Unofficial implementation of "Prompt-to-Prompt Image Editing with Cross Attention Control" with Stable Diffusion

mmc4

MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.

LibFewShot

LibFewShot: A Comprehensive Library for Few-shot Learning. TPAMI 2023.

Attend-and-Excite

Official Implementation for "Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models" (SIGGRAPH 2023)

harmonic-oscillator-pinn

Code accompanying my blog post: So, what is a physics-informed neural network?

ELITE

ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generation (ICCV 2023, Oral)

fromage

🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".

oft

Official implementation of "Controlling Text-to-Image Diffusion by Orthogonal Finetuning".

Ladder-Side-Tuning

PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"

layout-guidance

[WACV 2024] Training-Free Layout Control with Cross-Attention Guidance

CyCLIP

embodied-clip

Official codebase for EmbCLIP

counterfactual_generative_networks

[ICLR'21] Counterfactual Generative Networks

polyjuice

MONet-pytorch

Burgess et al. "MONet: Unsupervised Scene Decomposition and Representation"

dataset_difficulty

"Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)

evaluations

[AAAI 2024] ConceptBed Evaluations for Personalized Text-to-Image Diffusion Models

argparseweb

web.py based tool to automatically convert argparse-like command line interfaces to simple web interfaces

reliability-checklist

NLP tool for wide-range model reliability evaluations

Awesome-Personalized-Text-to-Image

conceptbed.github.io

gpt3_data_generation

Testing how well GPT3 can generate data