mouxingyang

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

scGPT

awesome-multi-omics

List of software packages for multi-omics analysis

awesome-deep-learning-single-cell-papers

CLIP_benchmark

CLIP-like model evaluation

protein_bert

Awesome-Healthcare-Foundation-Models

Awesome-MLLM-Hallucination

📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

scBERT

TCL

code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022

OPERA

[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

cav-mae

Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".

VCD

[CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding

missing_aware_prompts

Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23

protein-bert-pytorch

Implementation of ProteinBERT in Pytorch

awesome-foundation-model-single-cell-papers

scJoint

gpt-4v-distribution-shift

Code for "How Well Does GPT-4V(ision) Adapt to Distribution Shifts? A Preliminary Investigation"

MM_Robustness

[DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift

Awesome-Noisy-Correspondence

This is a summary of research on noisy correspondence. There may be omissions. If anything is missing please get in touch with us. Our emails: linyijie.gm@gmail.com yangmouxing@gmail.com qinyang.gm@gmail.com

less-is-more

Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)

scCLIP

2024-ICLR-READ

Pytorch implementation of "Test-time Adaption against Multi-modal Reliability Bias".

Awesome-Noisy-Correspondence

This is a summary of research on noisy correspondence. There may be omissions. If anything is missing please get in touch with us. Our emails: linyijie.gm@gmail.com yangmouxing@gmail.com qinyang.gm@gmail.com

ChatIR

Official repository of "Chatting Makes Perfect: Chat-based Image Retrieval"

PC2-NoiseofWeb

Noise of Web (NoW) is a challenging noisy correspondence learning (NCL) benchmark containing 100K image-text pairs for robust image-text matching/retrieval models.

VideoLanguageModelRobustness

A large scale robustness analysis for video and text, multimodal models on the YouCook2 and MSRVTT datasets.

2024-IJCV-LCNL

scmFormer