embodied-agent

There are 4 repositories under embodied-agent topic.

hyp1231 / awesome-llm-powered-agent
Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...
awesome-list chatgpt embodied-agent embodied-ai foundation-model foundation-models generative-agents generative-ai generative-model generative-models gpt-4 large-language-model large-language-models llm llm-powered-agents llms
1797
zchoi / Awesome-Embodied-Agent-with-LLMs
This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥
agent awesome embodied-agent embodied-ai large-language-model manipulator-robotics navigation planning-algorithms scene-understanding
1142
TheShadow29 / awesome-grounding
awesome grounding: A curated list of research papers in visual grounding
computer-vision natural-language-processing grounding awesome-list papers arxiv visual-grounding image-grounding video-understanding video-grounding captioning-images captioning-videos embodied-agent multimodal-deep-learning language-grounding paper paper-roadmap phrase-grounding
1046
Autonomous-Agents
tmgthb / Autonomous-Agents
Autonomous Agents (LLMs) research papers. Updated Daily.
autonomous-agents agents ai ai-agents embodied-agent generalist-agent llm llm-agents research-paper agent agentic aiagent aiagents llmagents
635
eric-ai-lab / awesome-vision-language-navigation
A curated list for vision-and-language navigation. ACL 2022 paper "Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions"
embodied-agent navigation vision-and-language vision-and-language-navigation
406
kyegomez / RT-2
Democratization of RT-2 "RT-2: New model translates vision and language into action"
artificial-intelligence attention-mechanism embodied-agent gpt4 multi-modal robotics transformer
Language:Python 405
haoranD / Awesome-Embodied-AI
A curated list of awesome papers on Embodied AI and related research/industry-driven resources.
awesome awesome-list classification detection embodied embodied-agent embodied-ai embodied-artificial-intelligence embodied-cognition languange learning navigation perception perceptron recognition segmentation understanding visual visual-language vlm
353
allenact
allenai / allenact
An open source framework for research in Embodied-AI from AI2.
ai ai2 computer-vision deep-learning embodied-agent python reinforcement-learning research
Language:Python 324
zju-vipa / Odyssey
Odyssey: Empowering Minecraft Agents with Open-World Skills
agent embodied-agent fine-tuning large-language-model large-language-models llm llm-agent minecraft
Language:JavaScript 282
RobotecAI / rai
RAI is a multi-vendor agent framework for robotics, utilizing Langchain and ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.
ai ai-agents-framework embodied-agent embodied-agents embodied-ai embodied-artificial-intelligence generative-ai llm multimodal o3de robotec robotics ros2 vlm
Language:Python 188
mbodiai / embodied-agents
Seamlessly integrate state-of-the-art transformer models into robotics stacks
agents artificial-intelligence diffusion embodied embodied-agent embodied-agents generative-ai large-language-models llm mbodi mbodiai multimodal robotics transformer vision-language-model vlm
Language:Python 185
Gary3410 / TaPA
[arXiv 2023] Embodied Task Planning with Large Language Models
ai2thor embodied-agent llama robotics
Language:Python 169
bigai-nlco / langsuite
Official Repo of LangSuitE
embodied-agent large-language-models autonomous-agents acl2024 llm-as-agent
Language:Python 81
Zhoues / MineDreamer
[NeurIPSw'24] This repo is the official implementation of "MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control "
diffusion-model embodied-agent minecraft multimodal-llm
Language:Python 77
mazpie / genrl
[NeurIPS 2024] GenRL: Multimodal-foundation world models enable grounding language and video prompts into embodied domains, by turning them into sequences of latent world model states. Latent state sequences can be decoded using the decoder of the model, allowing visualization of the expected behavior, before training the agent to execute it.
embodied-agent embodied-ai foundation-models multimodal reinforcement-learning world-models
Language:Python 64
opendilab / OpenPaL
Building open-ended embodied agent in battle royale FPS game
embodied-agent embodied-ai large-language-models open-ended-learning
37
declare-lab / Emma-X
Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
agents chain-of-thought embodied-agent embodied-ai embodied-artificial-intelligence embodied-intelligence llm robotics vla vlm
Language:Python 36
rese1f / STEVE
[ECCV 2024] STEVE in Minecraft is for See and Think: Embodied Agent in Virtual Environment
computer-vision minecraft dataset large-language-models embodied-agent llama
36
CEC-Agent / CEC
Official Implementation of NeurIPS'23 Paper "Cross-Episodic Curriculum for Transformer Agents"
deepmind-lab embodied-agent embodied-ai imitation-learning reinforcement-learning robosuite transformer transformer-models transformers
Language:Python 31
LoopMind-AI / loopquest
A Production Tool for Embodied AI
decision-making-algorithm foundation-model gym gym-environment mlops mlops-workflow reinforcement-learning rlops simulation reinforcement-learning-ops machine-learning offline-reinforcement-learning embodied-agent embodied-ai
Language:Python 29
ZJLAB-AMMI / LLM4Teach
Python code to implement LLM4Teach, a policy distillation approach for teaching reinforcement learning agents with Large Language Model
agents distillation llm minigrid reinforcement-learning decison-making embodied-agent
Language:Python 29
GenesisOrigin / Genesis
Official PyTorch Implementation of Genesis: Advancing Towards Efficient Embodiment Co-Design
embodied-agent pytorch reinforcement-learning robot-design
Language:Python 21
xyz9911 / FLAME
[AAAI-25 Oral] Official Implementation of "FLAME: Learning to Navigate with Multimodal LLM in Urban Environments"
large-multimodal-models multimodal-large-language-models vision-and-language-navigation vision-language-model embodied-agent streetview
Language:Python 19
raphael-sch / map2seq_vln
Code for ORAR Agent for Vision and Language Navigation on Touchdown and map2seq
vision-and-language vision-and-language-navigation vln embodied-agent street-view touchdown map2seq
Language:Python 14
wendell0218 / GVA-Survey
Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms
embodied-agent generalist-virtual-agent gui-agent gva llm mllm multi-agent-system survey virtual-agent vlm
12
Charmve / PuppyGo
vision language model and large language model powered embodied robot
chatgpt deepmind embodied-agent palm2 rt-2 voxposer
6
eric-ai-lab / Naivgation-as-wish
Official implementation of the NAACL 2024 paper "Navigation as Attackers Wish? Towards Building Robust Embodied Agents under Federated Learning"
attack-defense embodied-agent federated-learning robustness vision-and-language-navigation
Language:Python 5
feifeiobama / Awesome-Embodied-Instruction-Following
A leaderboard for Embodied Instruction Following papers and BibTeX entries
awesome bibtex embodied-agent
Language:TeX 5
eric-ai-lab / R2H
Official implementation of the EMNLP 2023 paper "R2H: Building Multimodal Navigation Helpers that Respond to Help Requests"
ai-agent embodied-agent helper multimodal navigation response-generation dialogue
Language:Python 4
nilax97 / Agent-Tracking
Tracking an embodied AI agent to estimate movement from observations
embodied-agent planning-algorithms uncertainty-estimation tracking-algorithm observation-models transistion-model state-estimation iit-delhi
Language:Python 2
seanxuu / Awesome-Embodied-AI
This is a curated list of awesome papers on Embodied AI.
awesome-list awesome-lists embodied embodied-agent embodied-ai embodied-artificial-intelligence embodied-cognition paper-reading agent artificial-intelligence robotics tool
1