vishaal27

search-agents

Code for the paper 🌳 Tree Search for Language Model Agents

richhf-18k

RichHF-18K dataset contains rich human feedback labels we collected for our CVPR'24 paper: https://arxiv.org/pdf/2312.10240, along with the file name of the associated labeled images (no urls or images are included in this dataset).

dangerous-capability-evaluations

MINT-1T

MINT-1T: A one trillion token multimodal interleaved dataset.

ml-mobileclip

This repository contains the official implementation of the research paper, "MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training" CVPR 2024

dclm

DataComp for Language Models

ilid

Industrial Language-Image Dataset (ILID), a web-crawled dataset containing language-image samples from various web catalogs, representing parts/components from the industrial domain.

concadia

BiVLC

goldfish-loss

Official implementation of Goldfish Loss: Mitigating Memorization in Generative LLMs

vl_compo

Recap-DataComp-1B

This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"

icai

Inverse Constitutional AI: compressing pairwise preference data into a short constitution of principles.

OmniCorpus

OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text

training-cost-trends

llm_dataset_inference

Official Repository for Dataset Inference for LLMs

CLoG

✌ CLoG: Benchmarking Continual Learning of Image Generation Models

matmulfreellm

Implementation for MatMul-free LM.

videophy

Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics

ReNO

ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization

clip-beyond-tail

Generalization Beyond Data Imbalance: A Controlled Study on CLIP for Transferable Insights

Flickr30k-Image-Viewer

Small Flask-based apps to browse the Flickr30k dataset.

schedules-and-scaling

MPS

OCRDatasets

A collection of OCR-related datasets

foildataset

Experiments on Foil Dataset

vl-probing

BLA

Benchmark for Basic Language Abilities of Multimodal Pretrained Transformers

svo_probes

The SVO-Probes Dataset for Verb Understanding

pointingqa

Code for paper "Point and Ask: Incorporating Pointing into Visual Question Answering"