YidFeng

CML

offical implementation of "Calibrating Multimodal Learning" on ICML 2023

CM-VQVAE

Research code for the WACV2024 paper "Complementary-Contradictory Feature Regularization against Multimodal Overfitting"

Multimodal-Learning-with-Alternating-Unimodal-Adaptation

Multimodal Learning Method MLA for CVPR 2024

FactorCL

[NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy

mPLUG-Owl

mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

Link-Context-Learning

MetaTransformer

Meta-Transformer for Unified Multimodal Learning

torchio

Medical imaging toolkit for deep learning

sam

SAM: Sharpness-Aware Minimization (PyTorch)

multi-domain-imbalance

[ECCV 2022] Multi-Domain Long-Tailed Recognition, Imbalanced Domain Generalization, and Beyond

rtdl

Research on Tabular Deep Learning: Papers & Packages

VAP_Former

[MICCAI-2023]Visual-Attribute Prompt Learning for Progressive Mild Cognitive Impairment Prediction

ADCCA

DomainKnowledge4AD

Med-PaLM

Towards Generalist Biomedical AI

kzhang-cs205-l0-smoothing

Parallel Image Smoothing via L0 Gradient Minimization

factorized

[ICLR 2019] Learning Factorized Multimodal Representations

TLC

PyTorch implementation of the paper "Trustworthy Long-Tailed Classification" (CVPR 2022)

MedFuse

CheSS

ViT-Adapter

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions

ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

perceiver-multi-modality-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

MADDi

This repository is for the Multimodal Alzheimer’s Disease Diagnosis framework (MADDi).

BenchMD

MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

HighMMT

[TMLR 2022] High-Modality Multimodal Transformer

ViPT

[CVPR23] Visual Prompt Multi-Modal Tracking

IOPaint

Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.

inat_comp

iNaturalist competition details