SenZHANG-GitHub

LLaVA-UHD

LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images

xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

X2-VLM

All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)

Bunny

A family of lightweight multimodal models.

self-correction-llm-papers

This is a collection of research papers for Self-Correcting Large Language Models with Automated Feedback.

SurgicalPart-SAM

Official implementation of SurgicalPart-SAM (SP-SAM)

Awesome-CV-Foundational-Models

stable-baselines3

PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

funsearch

LightZero

[NeurIPS 2023 Spotlight] LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios

SurgicalGym

High-performance GPU-based simulation platform for reinforcement learning with surgical robot learning

DEX

[ICRA'23] Demonstration-Guided Reinforcement Learning with Efficient Exploration for Task Automation of Surgical Robot

alpha-zero-general

A clean implementation based on AlphaZero for any game in any framework + tutorial + Othello/Gobang/TicTacToe/Connect4 and more

controlgym

Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms

IROS2023PaperList

IROS2023 Paper List

Reinforcement-Learning-2nd-Edition-by-Sutton-Exercise-Solutions

Solutions of Reinforcement Learning, An Introduction

HyQ

Official code repo for paper: Hybrid RL: Using both offline and online data can make RL efficient.

SurgicalSAM

Official implementation of SurgicalSAM

mup

maximal update parametrization (µP)

Awesome-Healthcare-Foundation-Models

prm800k

800,000 step-level correctness labels on LLM solutions to MATH problems

Reinforcement-Learning-Papers

Related papers for reinforcement learning, including classic papers and latest papers in top conferences

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

test

Measuring Massive Multitask Language Understanding | ICLR 2021

Prompt4ReasoningPapers

[ACL 2023] Reasoning with Language Model Prompting: A Survey

stable-baselines

A fork of OpenAI Baselines, implementations of reinforcement learning algorithms

PPO

PPO implementation for OpenAI gym environment based on Unity ML Agents

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)