junchen14

Multi-Modal-Transformer

The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised learning models. Additionally, it also collects many useful tutorials and tools in these related domains.

LoMaR

LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)

Awesome_ChatGPT_papers

This repository will collect and share awesome ChatGPT related papers and useful tools

MiniGPT-4_finetune

Open-sourced codes for MiniGPT-4 and MiniGPT-v2

RelTransformer_GeneralVRD

video_chatcaptioner

3DCoMPaT

Official repository for the 3DCoMPaT dataset (ECCV2022 Oral)

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

CLIP

Contrastive Language-Image Pretraining

CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

DL2Vec

Convert Description Logic axioms into a graph, and generate embedding representation for the nodes.

BLIP

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

junchen14.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

minigpt_spatial

video_language

ViLT

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

VisualGPT-1

web-llm

Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.