xwjabc

batch-face

Batch Face Detection and Alignment for Modern Research

iglue

[ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"

coco-cn

Enriching MS-COCO with Chinese sentences and tags for cross-lingual multimedia tasks

mBLIP

MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

clair

CLAIR: A (surprisingly) simple semantic text metric with large language models.

polygon-transformer

Grounded-Segment-Anything

Grounded-SAM: Marrying Grounding-DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

refer

Referring Expression Datasets API

clipscore

CLIPScore EMNLP code

FactualSceneGraph

FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.

FuseCap

FuseCap: Large Language Model for Visual Data Fusion in Enriched Caption Generation

label-studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format

cvat

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

awesome-chatgpt-prompts

This repo includes ChatGPT prompt curation to use ChatGPT better.

BARTScore

BARTScore: Evaluating Generated Text as Text Generation

captionGAN

Source code for the paper "Speaking the Same Language: Matching Machine to Human Captions by Adversarial Training"

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

Hallucination

image-paragraph-captioning

[EMNLP 2018] Training for Diversity in Image Paragraph Captioning

video-paragraph

Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021

VTCM-based-image-paragraph-caption

GRiT

GRiT: A Generative Region-to-text Transformer for Object Understanding (https://arxiv.org/abs/2212.00280)

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"

self-critical.pytorch

Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.

diht

Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training

infinibatch

Efficient, check-pointed data loading for deep learning with massive data sets.

Stable-Pix2Seq

A full-fledged version of Pix2Seq

Pretrained-Pix2Seq

Replication of Pix2Seq with Pretrained Model