zchoi

Awesome-Embodied-Agent-with-LLMs

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!

S2-Transformer

[IJCAI 2022] Official Pytorch code for paper “S2 Transformer for Image Captioning”

PKOL

[TIP 2022] Official code of paper “Video Question Answering with Prior Knowledge and Object-sensitive Learning”

VCRN

Multi-Modal-Large-Language-Learning

Awesome multi-modal large language paper/project, collections of popular training strategies, e.g., PEFT, LoRA.

SPT

[TCSVT23] Official code for "SPT: Spatial Pyramid Transformer for Image Captioning".

3D-Vision-and-Language

Collection of recent 3D Vision and Language research

SNLC

[PR23] The implementation of the paper ''Learning Visual Question Answering on Controlled Semantic Noisy Labels''

DAST

[MM23] Code for paper "Depth-Aware Sparse Transformer for Video-Language Learning"

GLSCL

Code for "Text-Video Retrieval with Global-Local Semantic Consistent Learning"

zchoi

videoqa_model

MAN

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

annotated_deep_learning_paper_implementations

🧑‍🏫 59 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

chatbot

CR

EMCL

[NeurIPS 2022] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations

Generalization-Causality

关于domain generalization，domain adaptation，causality，robutness，prompt，optimization，generative model各式各样研究的阅读笔记

LMaaS-Papers

Awesome papers on Language-Model-as-a-Service (LMaaS)

McQuic

Repository of CVPR'22 paper "Unified Multivariate Gaussian Mixture for Efficient Neural Image Compression"

PommesPeter

rich

Rich is a Python library for rich text and beautiful formatting in the terminal.

sam

SAM: Sharpness-Aware Minimization (PyTorch)

Vision-and-Language-Benchmark

Codebase for research of vision&language, including various multimodal task pipline (e.g., image captioning, VQA, video-text retrieval), customizable dataset (e.g., MS-COCO, ActivityNet, MSR-VTT), pre-trained model acquire (e.g., CLIP, BLIP-2)

zchoi.github.io

My personal homepage

UMP_TVR

distribuuuu

The pure and clear PyTorch Distributed Training Framework.

MPT