vishaal27

T-GATE

T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!

ViTamin

[CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"

imagenot

The accompanying code of "ImageNot: A contrast with ImageNet preserves model rankings"

CSD

dove

routerbench

The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System

research-career-tools

chug

Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.

ex2

If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions

MORE

Visual-Table

Stay tuned!

IG-VLM

imagenet_d

[CVPR2024 Highlight] Official Code for "ImageNet-D: Benchmarking Neural Network Robustness on Diffusion Synthetic Object"

coco-rem

Code for the paper "Benchmarking Object Detectors with COCO: A New Path Forward."

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Inflection-Benchmarks

Public Inflection Benchmarks

dbrx

Code examples and resources for DBRX, a large language model developed by Databricks

LAMM

[NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents

attention-interpolation-diffusion

Interpolation Between Text-to-Image Generation!

modelgauge

Make it easy to automatically and uniformly measure the behavior of many AI Systems.

LLM-SLERP-Merge

Spherical Merge Pytorch/HF format Language Models with minimal feature loss.

Visual-CoT

Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning

DreamLIP

[Arxiv 2024] Offical Pytorch implementation of DreamLIP: Language-Image Pre-training with Long Captions

ALLaVA

Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model

mixinglaws

visual_diversity_budget

Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost

emergent_in_context_learning

skerch

Sketched matrix decompositions for PyTorch

mup

maximal update parametrization (µP)