vision-and-language-pre-training

There are 2 repositories under vision-and-language-pre-training topic.

salesforce / BLIP
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
vision-language vision-and-language-pre-training image-text-retrieval image-captioning visual-question-answering visual-reasoning vision-language-transformer
Language:Jupyter Notebook 4254
OFA-Sys / Chinese-CLIP
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
chinese clip computer-vision contrastive-loss coreml-models deep-learning image-text-retrieval multi-modal multi-modal-learning nlp pretrained-models pytorch transformers vision-and-language-pre-training vision-language
Language:Python 3602
Paranioar / Awesome_Cross_Modal_Pretraining_Transfering
The Paper List of Cross-Modal Matching / Pretraining / Transfering for Preliminary Insight.
cross-modal-retrieval tutorial visual-semantic-embeddings awesome-list parameter-efficient-tuning vision-and-language-pre-training large-multimodal-models
347
phellonchen / awesome-Vision-and-Language-Pre-training
Recent Advances in Vision and Language Pre-training (VLP)
vision-and-language-pre-training vision-and-language pretraining multimodal-deep-learning vlp
277
zhjohnchan / awesome-vision-and-language-pretraining
A curated list of vision-and-language pre-training (VLP). :-)
multi-modal-learning pre-training vision-and-language-pre-training
54
PrithivirajDamodaran / vision-language-modelling-series
Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations
multimodal-deep-learning multimodal-interactions multimodal-representation vision-and-language vision-and-language-navigation vision-and-language-pre-training
Language:Jupyter Notebook 14
mala-lab / SIC-CADS
Code Implementation of "Simple Image-level Classification Improves Open-vocabulary Object Detection" (AAAI'24)
object-detection open-vocabulary-detection vision-and-language-pre-training
Language:Python 12
JianqiangWan / VLPT-STD
Vision-Language Pre-Training for Boosting Scene Text Detectors (CVPR2022)
vision-and-language-pre-training scene-text-detection multimodal-deep-learning
11
marialymperaiou / knowledge-enhanced-multimodal-learning
A list of research papers on knowledge-enhanced multimodal learning
conditional-image-generation image-text-matching image-text-retrieval knowledge-graph multimodal-deep-learning multimodal-retrieval story-visualization vision-and-language vision-and-language-navigation vision-and-language-pre-training vision-language-transformer visual-commonsense-reasoning visual-dialog visual-grounding visual-question-answering visual-reasoning visual-storytelling multi-task-learning knowledge-enhanced-multimodal-learning knowledge-enhanced-vision-language
7
SHTUPLUS / GITM-MR
The official implementation for the ICCV 2023 paper "Grounded Image Text Matching with Mismatched Relation Reasoning".
vision-and-language vision-language-model vision-and-language-pre-training vision-language-dataset vision-language-learning
Language:Python 5