497662892

notero

A Zotero plugin for syncing items and notes into Notion

vstar

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"

SkinGPT-4

Pre-trained Multimodal Large Language Model Enhances Dermatological Diagnosis using SkinGPT-4

HuatuoGPT-II

HuatuoGPT2, One-stage Training for Medical Adaption of LLMs. (An Open Medical GPT)

HuatuoGPT

HuatuoGPT, Towards Taming Language Models To Be a Doctor. (An Open Medical GPT)

MMedLM

The official codes for "Towards Building Multilingual Language Model for Medicine"

VISA

[ECCV24] VISA: Reasoning Video Object Segmentation via Large Language Model

Score-Entropy-Discrete-Diffusion

[ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)

XrayGPT

[BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

RaDialog

Official code for the Paper "RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance"

VisionLLM

VisionLLM Series

Agent-Attention

Official repository of Agent Attention (ECCV2024)

StoP

mem0

The memory layer for Personalized AI

nmed2024

AI-based differential diagnosis of dementia etiologies on multimodal data

hello-algo

《Hello 算法》：动画图解、一键运行的数据结构与算法教程。支持 Python, Java, C++, C, C#, JS, Go, Swift, Rust, Ruby, Kotlin, TS, Dart 代码。简体版和繁体版同步更新，English version ongoing

SegVol

The official code for "SegVol: Universal and Interactive Volumetric Medical Image Segmentation".

LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

tutorials

MONAI Tutorials

1d-tokenizer

This repo contains the code for our paper An Image is Worth 32 Tokens for Reconstruction and Generation

ttt-lm-jax

Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

ttt-lm-pytorch

Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

M3D

M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models

aide

Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码：一键注释、转换、UI 图生成代码、AI 批量处理文件！💪

HuatuoGPT-Vision

Medical Multimodal LLMs

BrainDecodesDeepNets

PyTorch implementation of "Brain Decodes Deep Nets"

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

diffusion-classifier

Diffusion Classifier leverages pretrained diffusion models to perform zero-shot classification without additional training

MMGL

Multi-modal Graph learning for Disease Prediction (IEEE Trans. on Medical imaging, TMI2022)