xwjabc

awesome-chatgpt-prompts

This repo includes ChatGPT prompt curation to use ChatGPT better.

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

label-studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

cvat

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"

MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

self-critical.pytorch

Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning. and others.

refer

Referring Expression Datasets API

BARTScore

BARTScore: Evaluating Generated Text as Text Generation

GRiT

GRiT: A Generative Region-to-text Transformer for Object Understanding (https://arxiv.org/abs/2212.00280)

Stable-Pix2Seq

A full-fledged version of Pix2Seq

infinibatch

Efficient, check-pointed data loading for deep learning with massive data sets.

clipscore

CLIPScore EMNLP code

coco-cn

Enriching MS-COCO with Chinese sentences and tags for cross-lingual multimedia tasks

diht

Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training

polygon-transformer

image-paragraph-captioning

[EMNLP 2018] Training for Diversity in Image Paragraph Captioning

FactualSceneGraph

FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.

mBLIP

captionGAN

Source code for the paper "Speaking the Same Language: Matching Machine to Human Captions by Adversarial Training"

video-paragraph

Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021

Pretrained-Pix2Seq

Replication of Pix2Seq with Pretrained Model

batch-face

Batch Face Processing for Modern Research, including face detection, face alignment, face reconstruction, head pose estimation

Hallucination

iglue

[ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"

FuseCap

FuseCap: Large Language Model for Visual Data Fusion in Enriched Caption Generation

clair

CLAIR: A (surprisingly) simple semantic text metric with large language models.

VTCM-based-image-paragraph-caption