embodied-ai

There are 8 repositories under embodied-ai topic.

Otter
Luodian / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
artificial-inteligence chatgpt deep-learning embodied-ai foundation-models gpt-4 instruction-tuning large-scale-models machine-learning multi-modality visual-language-learning
Language:Python 3521
unrealcv / unrealcv
UnrealCV: Connecting Computer Vision to Unreal Engine
computer-vision embodied-ai machine-learning simulation synthetic-data ue4 virtual-worlds
Language:C++ 1866
theseus
facebookresearch / theseus
A library for differentiable nonlinear optimization
bilevel-optimization computer-vision deep-learning differentiable-optimization embodied-ai gauss-newton implicit-differentiation levenberg-marquardt nonlinear-least-squares pytorch robotics
Language:Python 1674
dora-rs / dora
DORA (Dataflow-Oriented Robotic Application) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.
dataflow embodied-ai low-latency robotics rust
Language:Rust 1375
hyp1231 / awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
awesome-list chatgpt embodied-agent embodied-ai foundation-model foundation-models generative-agents generative-ai generative-model generative-models gpt-4 large-language-model large-language-models llm llm-powered-agents llms
1223
zchoi / Awesome-Embodied-Agent-with-LLMs
This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!
embodied-agent embodied-ai scene-understanding navigation planning-algorithms manipulator-robotics awesome agent large-language-model
744
OpenRL-Lab / openrl
Unified Reinforcement Learning Framework
distributed-reinforcement-learning embodied google-research-football gym gymnasium multi-agent-reinforcement-learning pytorch reinforcement-learning robotics self-playing autodrive embodied-ai game-ai mcts-algorithm atari mujoco llm llm-as-agent
Language:Python 604
haosulab / ManiSkill
SAPIEN Manipulation Skill Framework, a GPU parallelized robotics simulator and benchmark
3d-computer-vision computer-vision embodied-ai reinforcement-learning robot-manipulation robotics robotics-simulation simulation-environment
Language:Python 591
OpenDriveLab / DriveAGI
[Incl. GenAD, CVPR 2024 Highlight] Embracing Foundation Models into Autonomous Agent and System
autonomous-driving embodied-ai foundation-model general-artificial-intelligence policy-learning
Language:Python 479
huangwl18 / VoxPoser
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
embodied-ai foundation-models large-language-models motion-planning robotic-manipulation robotics vision-language-model
Language:Python 473
allenai / procthor
🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses
ai2-thor computer-vision embodied-ai procedural-generation robotics
Language:Python 246
geng-haoran / Simulately
A universal summary of current robotics simulators
awesome embodied-ai robotics robotics-programming simulation simulator
Language:TypeScript 238
huangwl18 / language-planner
Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"
artificial-intelligence codex deep-learning embodied-ai foundation-models gpt-3 in-context-learning knowledge-extraction language-model planning transformers
Language:Jupyter Notebook 235
haoranD / Awesome-Embodied-AI
A curated list of awesome papers on Embodied AI and related research/industry-driven resources.
awesome awesome-list classification detection embodied embodied-agent embodied-ai embodied-artificial-intelligence embodied-cognition languange learning navigation perception perceptron recognition segmentation understanding visual visual-language vlm
180
thunlp / LEGENT
Open Platform for Embodied Agents
embodied-ai language-grounding large-multimodal-models physics-engine robot-simulator
Language:Python 177
MarSaKi / ETPNav
[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"
embodied-ai topological-maps vision-and-language vision-language-navigation vision-language-pre-training
Language:Python 173
MarSaKi / VLN-BEVBert
[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"
embodied-ai transformer vision-language
Language:Python 171
simpler-env / SimplerEnv
Evaluating and reproducing real-world robot manipulation policies (e.g., RT-1, RT-1-X, Octo) in simulation under common setups (e.g., Google Robot, WidowX+Bridge)
computer-vision embodied-ai real2sim reinforcement-learning robot-learning robot-manipulation robotics robotics-benchmark robotics-simulation
Language:Jupyter Notebook 170
rllab-snu / RNR-Map
Official Github repository for "Renderable Neural Radiance Map for Visual Navigation‬". (CVPR 2023)
embodied-ai habitat-sim image-goal-navigation nerf neural-rendering pytorch slam visual-navigation
120
zd11024 / NaviLLM
[CVPR 2024] The code for paper 'Towards Learning a Generalist Model for Embodied Navigation'
3d-question-answering embodied-ai large-language-models multi-task-learning vision-language-navigation
Language:Python 96
allenai / manipulathor
ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm
embodied-ai object-manipulation ai2thor-environment manipulathor
Language:Jupyter Notebook 89
YicongHong / Discrete-Continuous-VLN
Code and Data of the CVPR 2022 paper: Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation
cvpr2022 vision-and-language-navigation vision-and-language embodied-ai computer-vision deep-learning visual-navigation
Language:Python 79
eric-ai-lab / VLMbench
NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"
compositionality embodied-ai language-grounding robotic-manipulation vision-and-language
Language:Python 77
MarSaKi / NvEM
[ACM MM 2021 Oral] Official repo of "Neighbor-view Enhanced Model for Vision and Language Navigation"
embodied-ai vision-and-language vision-language-navigation
Language:C++ 77
BraveGroup / SheetCopilot
We release a general framework for prompting LLMs to manipulate software in a closed-loop manner.
artificial-intelligence embodied-ai llm llm-based-agent
Language:Python 73
Book-of-MLM
HCPLab-SYSU / Book-of-MLM
《多模态大模型：新一代人工智能技术范式》作者：刘阳，林倞
aigc embodied-ai large-language-models multimodal world-models
Language:HTML 69
Xiaoming-Zhao / PointNav-VO
[ICCV 2021] Official implementation of "The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation"
iccv2021 embodied-ai computer-vision visual-odometry indoor-navigation deep-learning
Language:Python 65
yyvhang / lemon_3d
3d-models cvpr2024 embodied-ai
Language:Python 62
csiro-robotics / Uncertainty-LPR
📣 [IEEE IROS 2023] Official Repository of IROS 23 paper "Uncertainty-Aware Lidar Place Recognition in Novel Environments"
deeplearning embodied-ai lidar place-recognition robotics uncertainty
Language:Python 57
2toinf / DecisionNCE
[ICML 2024] The offical Implementation of "DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning"
decision-making embodied-ai multimodal pytorch-implementation representation-learning robotics
Language:Python 56
rllab-snu / Visual-Graph-Memory
Official GitHub Repository for paper "Visual Graph Memory with Unsupervised Representation for Visual Navigation", ICCV 2021
embodied-ai habitat-sim image-goal-navigation imitation-learning pytorch reinforcement-learning visual-navigation
Language:Python 55
3dlg-hcvc / hssd
Code repository for the Habitat Synthetic Scenes Dataset (HSSD) paper.
3d-scenes embodied-ai
Language:Python 49
HanqingWangAI / Active_VLN
The repository of ECCV 2020 paper `Active Visual Information Gathering for Vision-Language Navigation`
eccv2020 embodied-ai embodied-navigation navigation room-to-room vision-language
Language:Python 43
FudanDISC / ReForm-Eval
An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
gpt4 instruction-tuning large-language-models llm multimodal pre-training large-vision-language-models benchmark embodied-ai in-context-learning instruction-following multimodal-chain-of-thought visual-chain-of-thought reformulation
Language:Python 32
opendilab / OpenPaL
Building open-ended embodied agent in battle royale FPS game
large-language-models open-ended-learning embodied-agent embodied-ai
31
CEC-Agent / CEC
Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
deepmind-lab embodied-agent embodied-ai imitation-learning reinforcement-learning robosuite transformer transformer-models transformers
Language:Python 30

embodied-ai

Luodian / Otter

unrealcv / unrealcv

facebookresearch / theseus

dora-rs / dora

hyp1231 / awesome-llm-powered-agent

zchoi / Awesome-Embodied-Agent-with-LLMs

OpenRL-Lab / openrl

haosulab / ManiSkill

OpenDriveLab / DriveAGI

huangwl18 / VoxPoser

allenai / procthor

geng-haoran / Simulately

huangwl18 / language-planner

haoranD / Awesome-Embodied-AI

thunlp / LEGENT

MarSaKi / ETPNav

MarSaKi / VLN-BEVBert

simpler-env / SimplerEnv

rllab-snu / RNR-Map

zd11024 / NaviLLM

allenai / manipulathor

YicongHong / Discrete-Continuous-VLN

eric-ai-lab / VLMbench

MarSaKi / NvEM

BraveGroup / SheetCopilot

HCPLab-SYSU / Book-of-MLM

Xiaoming-Zhao / PointNav-VO

yyvhang / lemon_3d

csiro-robotics / Uncertainty-LPR

2toinf / DecisionNCE

rllab-snu / Visual-Graph-Memory

3dlg-hcvc / hssd

HanqingWangAI / Active_VLN

FudanDISC / ReForm-Eval

opendilab / OpenPaL

CEC-Agent / CEC