embodied-ai

There are 6 repositories under embodied-ai topic.

Otter
Luodian / Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
artificial-inteligence chatgpt deep-learning embodied-ai foundation-models gpt-4 instruction-tuning large-scale-models machine-learning multi-modality visual-language-learning
Language:Python 3444
unrealcv / unrealcv
UnrealCV: Connecting Computer Vision to Unreal Engine
virtual-worlds computer-vision ue4 embodied-ai machine-learning simulation synthetic-data
Language:C++ 1829
theseus
facebookresearch / theseus
A library for differentiable nonlinear optimization
differentiable-optimization robotics embodied-ai nonlinear-least-squares pytorch deep-learning computer-vision gauss-newton levenberg-marquardt implicit-differentiation bilevel-optimization
Language:Python 1602
hyp1231 / awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
awesome-list embodied-agent embodied-ai foundation-model foundation-models generative-agents generative-ai generative-model generative-models large-language-model large-language-models llms llm chatgpt gpt-4 llm-powered-agents
946
OpenRL-Lab / openrl
Unified Reinforcement Learning Framework
atari autodrive distributed-reinforcement-learning embodied embodied-ai game-ai google-research-football gym gymnasium llm llm-as-agent mcts-algorithm mujoco multi-agent-reinforcement-learning pytorch reinforcement-learning robotics self-playing
Language:Python 556
zchoi / Awesome-Embodied-Agent-with-LLMs
This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!
agent awesome embodied-agent embodied-ai large-language-model manipulator-robotics navigation planning-algorithms scene-understanding
534
haosulab / ManiSkill2
SAPIEN Manipulation Skill Benchmark 2
3d-computer-vision reinforcement-learning robotics computer-vision robot-manipulation simulation-environment skill-learning embodied-ai robotics-simulation
Language:Python 397
OpenDriveLab / DriveAGI
[Incl. GenAD, CVPR 2024 Highlight] Embracing Foundation Models into Autonomous Agent and System
foundation-model autonomous-driving embodied-ai general-artificial-intelligence policy-learning
Language:Python 359
huangwl18 / VoxPoser
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models
embodied-ai foundation-models large-language-models motion-planning robotic-manipulation robotics vision-language-model
Language:Python 358
allenai / procthor
🏘️ Scaling Embodied AI by Procedurally Generating Interactive 3D Houses
ai2-thor computer-vision embodied-ai procedural-generation robotics
Language:Python 227
huangwl18 / language-planner
Official Code for "Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents"
language-model gpt-3 codex transformers artificial-intelligence planning knowledge-extraction in-context-learning foundation-models deep-learning embodied-ai
Language:Jupyter Notebook 227
geng-haoran / Simulately
A universal summary of current robotics simulators
awesome embodied-ai robotics robotics-programming simulation simulator
Language:TypeScript 180
MarSaKi / VLN-BEVBert
[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"
embodied-ai transformer vision-language
Language:Python 162
MarSaKi / ETPNav
[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"
embodied-ai vision-and-language topological-maps vision-language-navigation vision-language-pre-training
Language:Python 161
rllab-snu / RNR-Map
Official Github repository for "Renderable Neural Radiance Map for Visual Navigation‬". (CVPR 2023)
embodied-ai habitat-sim image-goal-navigation nerf neural-rendering pytorch slam visual-navigation
116
haoranD / Awesome-Embodied-AI
A curated list of awesome papers on Embodied AI and related research/industry-driven resources.
awesome awesome-list classification detection embodied embodied-agent embodied-ai embodied-artificial-intelligence embodied-cognition languange learning navigation perception perceptron recognition segmentation understanding visual visual-language vlm
105
allenai / manipulathor
ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm
embodied-ai object-manipulation ai2thor-environment manipulathor
Language:Jupyter Notebook 86
MarSaKi / NvEM
[ACM MM 2021 Oral] Official repo of "Neighbor-view Enhanced Model for Vision and Language Navigation"
vision-and-language embodied-ai vision-language-navigation
Language:C++ 77
YicongHong / Discrete-Continuous-VLN
Code and Data of the CVPR 2022 paper: Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation
cvpr2022 vision-and-language-navigation vision-and-language embodied-ai computer-vision deep-learning visual-navigation
Language:Python 75
eric-ai-lab / VLMbench
NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"
compositionality embodied-ai language-grounding robotic-manipulation vision-and-language
Language:Python 69
zd11024 / NaviLLM
[CVPR 2024] The code for paper 'Towards Learning a Generalist Model for Embodied Navigation'
embodied-ai large-language-models 3d-question-answering vision-language-navigation multi-task-learning
Language:Python 62
Xiaoming-Zhao / PointNav-VO
[ICCV 2021] Official implementation of "The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation"
computer-vision deep-learning embodied-ai iccv2021 indoor-navigation visual-odometry
Language:Python 59
BraveGroup / SheetCopilot
We release a general framework for prompting LLMs to manipulate software in a closed-loop manner.
artificial-intelligence embodied-ai llm llm-based-agent
Language:Python 54
csiro-robotics / Uncertainty-LPR
📣 [IEEE IROS 2023] Official Repository of IROS 23 paper "Uncertainty-Aware Lidar Place Recognition in Novel Environments"
deeplearning embodied-ai lidar place-recognition robotics uncertainty
Language:Python 53
rllab-snu / Visual-Graph-Memory
Official GitHub Repository for paper "Visual Graph Memory with Unsupervised Representation for Visual Navigation", ICCV 2021
embodied-ai habitat-sim image-goal-navigation imitation-learning pytorch reinforcement-learning visual-navigation
Language:Python 52
yyvhang / lemon_3d
3d-models cvpr2024 embodied-ai
Language:Python 44
HanqingWangAI / Active_VLN
The repository of ECCV 2020 paper `Active Visual Information Gathering for Vision-Language Navigation`
eccv2020 embodied-ai embodied-navigation vision-language navigation room-to-room
Language:Python 43
3dlg-hcvc / hssd
Code repository for the Habitat Synthetic Scenes Dataset (HSSD) paper.
3d-scenes embodied-ai
Language:Python 42
thunlp / LEGENT
An open platform for embodied intelligence
embodied-ai language-grounding large-multimodal-models physics-engine robot-simulator
Language:Python 35
CEC-Agent / CEC
Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
deepmind-lab embodied-agent embodied-ai imitation-learning reinforcement-learning robosuite transformer transformer-models transformers
Language:Python 29
FudanDISC / ReForm-Eval
An benchmark for evaluating the capabilities of large vision-language models (LVLMs)
benchmark embodied-ai gpt4 in-context-learning instruction-following instruction-tuning large-language-models large-vision-language-models llm multimodal multimodal-chain-of-thought pre-training reformulation visual-chain-of-thought
Language:Python 29
allenai / phone2proc
📱👉🏠 Perform conditional procedural generation to generate houses like your own!
ai2-thor artificial-intelligence computer-vision embodied-ai robotics procthor
Language:Python 28
2toinf / DecisionNCE
The offical Implementation of "DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning"
decision-making embodied-ai multimodal pytorch-implementation representation-learning robotics
Language:Python 26
LoopMind-AI / loopquest
A Production Tool for Embodied AI
decision-making-algorithm foundation-model gym gym-environment mlops mlops-workflow reinforcement-learning rlops simulation reinforcement-learning-ops machine-learning offline-reinforcement-learning embodied-agent embodied-ai
Language:Python 26
allenai / robustnav
Evaluating pre-trained navigation agents under corruptions
embodied-ai ai2thor-environment visual-navigation embodied-vision computer-vision deep-reinforcement-learning
Language:Python 25
phlippe / BISCUIT
Official code of the paper "BISCUIT: Causal Representation Learning from Binary Interactions" (UAI 2023)
causal-representation-learning deep-learning embodied-ai identifiability
Language:Python 24