SiyuanYan1

awesome-self-supervised-learning

A curated list of awesome self-supervised methods

LLaVA-NeXT

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

cambrian

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

CLIP_benchmark

CLIP-like model evaluation

prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)

CLIPA

[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"

MedFM

Official Repository of NeurIPS 2023 - MedFM Challenge

ZegCLIP

Official implement of CVPR2023 ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentation

CT-CLIP

Developing Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomography

MedRAG

Code for the MedRAG toolkit

bioclip

This is the repository for the BioCLIP model and the TreeOfLife-10M dataset [CVPR'24 Oral, Best Student Paper].

vilmedic

ViLMedic (Vision-and-Language medical research) is a modular framework for vision and language multimodal research in the medical field

HEST

HEST: Bringing Spatial Transcriptomics and Histopathology together - NeurIPS 2024

SliME

✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models

SimPer

[ICLR 2023, Oral] SimPer: Simple Self-Supervised Learning of Periodic Targets

Siamese-neural-network-for-change-detection

This repository contains the python code for a Siamese neural network to detect changes in aerial images using Tensorflow.

cxr-clip

MM-Retinal

MedDr

A generalist foundation model for healthcare capable of handling diverse medical data modalities.

MVG

ViLa-MIL

ViLa-MIL: Dual-scale Vision-Language Multiple Instance Learning for Whole Slide Image Classification (CVPR 2024)

Mammo-CLIP

Official Pytorch implementation of MICCAI 2024 paper (early accept, top 11%) Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammography

RET-CLIP

RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports

medmnistc-api

Python library for evaluating and enhancing model robustness in medical image analysis.

awesome-large-vision-language-models

Advances in recent large vision language models (LVLMs)

CPLIP

2024-challenge-dataset

Set of scripts and instructions for sub-selecting and formatting raw data exported by the Canfield ISIC2024 Tile Export Tool. The resulting dataset was prepared for a competition on Kaggle held during the Summer of 2024.

star-ed

skin tone analysis for representation in medical educational materials using machine learning

ISIC2024_Baselines