ShiYaya

emscore

Research code for CVPR 2022 paper: "EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching"

prompt-for-cross-modal-tasks

video-classification-3d-cnn-pytorch

Awesome_Evaluation_Metrics_for_Text_Generation

UniVSE

UniVSE implementation on Python3

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

Application_of_T5

AREL

Code for the ACL paper "No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling"

awesome-image-captioning

A curated list of image captioning and related area resources. :-)

awesome-MIM

Reading list for research topics in Masked Image Modeling

bert_score

BERT score for text generation

CLIP

Contrastive Language-Image Pretraining

DataRelease

Data Release for VALUE Benchmark

diffusion-image-captioning

implementation of paper https://arxiv.org/abs/2210.04559

drawio_files

eval_cap

common visual captioning evaluation metrics

GMNMT

HERO_Video_Feature_Extractor_MIL_NCE

My_Blog_Issues

Oscar

Oscar and VinVL

SeqDiffuSeq

SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers

ShiYaya

Config files for my GitHub profile.

ShiYaya.github.io

summarize-from-feedback

Code for "Learning to summarize from human feedback"

TextRL

Reinforcement learning in text generation with transformers

tmp

visual-paraphrases-captioning

Code for the ICCV 2019 Paper "Generating Diverse and Descriptive Image Captions Using Visual Paraphrases"

VLPs_Extract_Video_Text_Embeddings

Use various large-scale models to extract video and text embeddigs

vq-vae-2-pytorch

Implementation of Generating Diverse High-Fidelity Images with VQ-VAE-2 in PyTorch

whiten