yangyuke001

3D-VLA

[ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model

SegmentAnything3D

[ICCV'23 Workshop] SAM3D: Segment Anything in 3D Scenes

Awesome-Embodied-Agent-with-LLMs

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥

RT-2

Democratization of RT-2 "RT-2: New model translates vision and language into action"

embodied-agents

Seamlessly integrate state-of-the-art transformer models into robotics stacks

robotic-transformer-pytorch

Implementation of RT1 (Robotic Transformer) in Pytorch

habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.

Awesome-Embodied-AI

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

Qwen2

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。

dino-tracker

Official Pytorch Implementation for “DINO-Tracker: Taming DINO for Self-Supervised Point Tracking in a Single Video”

narrator

David Attenborough narrates your life

FlagEmbedding

Retrieval and Retrieval-augmented LLMs

YOLO-World

[CVPR 2024] Real-Time Open-Vocabulary Object Detection

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

modelscope-agent

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

h2o-llmstudio

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

Grounding-DINO-1.5-API

API for Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series

SEED-X

Multimodal Models in Real World

llama3

The official Meta Llama 3 GitHub site

SD-inference

Stable Diffusion inference

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Monkey

【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models

Awesome-ChatGPT

ChatGPT资料汇总学习，持续更新......

ProPainter

[ICCV 2023] ProPainter: Improving Propagation and Transformer for Video Inpainting

IOPaint

Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.

AnyText

Official implementation code of the paper <AnyText: Multilingual Visual Text Generation And Editing>