lalithjets

TaskMatrix

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

openai-python

The official Python library for the OpenAI API

guidance

A guidance language for controlling large language models.

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

OpenDelta

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

D-NeRF

LaViLa

Code release for "Learning Video Representations from Large Language Models"

BiomedGPT

BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks

SAMed

The implementation of the technical report: "Customized Segment Anything Model for Medical Image Segmentation"

autoresearcher

⚡ Automating scientific workflows with AI ⚡

SceneRF

[ICCV 2023] Official implementation of "SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fields"

EndoNeRF

Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery

medical-ai-research-foundations

ambf

Asynchronous Multi-Body Framework

sawIntuitiveResearchKit

cisst/SAW stack for the da Vinci Research Kit (dVRK)

dvrk-ros

daVinci Research Kit ROS stack. See dVRK wiki to get started: https://github.com/jhu-dvrk/sawIntuitiveResearchKit/wiki

surgical_robotics_challenge

Interactive Robot Assisted Suturing Simulation

Surgical_VQA

Surgical Visual Question Answering. A transformer-based surgical VQA model. Offical Implementation of "Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformers", MICCAI 2022.

sofa_env

Reinforcement learning environments for robot-assisted laparoscopic surgery

SurgicalGPT

Surgical-VQLA

Official implementation of "Surgical-VQLA: Transformer with Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgery", ICRA 2023.

GPT-Enabled-HSR-CoSpeechGestures

P-CD

GradCAMDownstreamTask

Domain-adaptation-in-MTL

Domain adaptation in surgical scene understanding. A MTL model for scene graph and scene captioning. Offical implementation of "Task-Aware Asynchronous MTL with Class Incremental Contrastive Learning for Surgical Scene Understanding", IJCARs 2022.

GradCAMDownstreamTask

End-to-end surgical scene understanding models using gradient-based localization. Official implementation of "Rethinking Feature Extraction: Gradient-based Localized Feature Extraction for End-to-End Surgical Downstream Tasks", RAL 2022.

lalithjets.github.io

P-CD