language-grounding

There are 2 repositories under language-grounding topic.

TheShadow29 / awesome-grounding
awesome grounding: A curated list of research papers in visual grounding
computer-vision natural-language-processing grounding awesome-list papers arxiv visual-grounding image-grounding video-understanding video-grounding captioning-images captioning-videos embodied-agent multimodal-deep-learning language-grounding paper paper-roadmap phrase-grounding
965
microsoft / GODEL
Large-scale pretrained models for goal-directed dialog
data-processing dialogue dialogue-systems machine-learning text-data text-generation transformers conversational-ai language-grounding grounded-generation dialogpt language-model pretrained-model pytorch transformer
Language:Python 836
devendrachaplot / DeepRL-Grounding
Train an RL agent to execute natural language instructions in a 3D Environment (PyTorch)
pytorch reinforcement-learning language-grounding gated-attention pytorch-rl a3c-lstm
Language:Python 237
princeton-nlp / WebShop
[NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
decision-making language language-grounding ml nlp rl rl-environment shopping sim-to-real web-based
Language:Python 213
thunlp / LEGENT
Open Platform for Embodied Agents
embodied-ai language-grounding large-multimodal-models physics-engine robot-simulator
Language:Python 124
WuJie1010 / Awesome-Temporally-Language-Grounding
A curated list of “Temporally Language Grounding” and related area
video-understanding language-grounding temporal-activity-localization temporal-language-grounding charades activitynet-captions
112
kdexd / lang-emerge-parlai
Implementation of EMNLP 2017 Paper "Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialog" using PyTorch and ParlAI
pytorch parlai emnlp language-grounding reinforcement-learning
Language:Python 105
WuJie1010 / Temporally-language-grounding
A Pytorch implemention for some state-of-the-art models for" Temporally Language Grounding in Untrimmed Videos"
video-understanding language-grounding temporal-activity-localization temporal-language-grounding charades activitynet-captions
Language:Python 97
eric-ai-lab / VLMbench
NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"
compositionality embodied-ai language-grounding robotic-manipulation vision-and-language
Language:Python 70
WuJie1010 / TSP-PRL
Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Video (AAAI2020)
aaai2020 video-analysis language-grounding reinforcement-learning
Language:Python 45
princeton-vl / Rel3D
Official code for NeurRIPS 2020 paper "Rel3D: A Minimally Contrastive Benchmark for Grounding Spatial Relations in 3D"
neurips-2020 3d-vision language-grounding spatial-relation-recognition spatial-relationships
Language:Python 24
Near32 / ReferentialGym
This framework provides out-of-the-box implementations of Referential Games variants in order to study the emergence of artificial languages using deep learning, relying on PyTorch (https://www.pytorch.org).
deep-learning referential-games language-emergence language-grounding pytorch language-processing neural-networks artificial-languages python visual-dialog
Language:Python 18
princeton-nlp / XTX
[ICLR 2022 Spotlight] Multi-Stage Episodic Control for Strategic Exploration in Text Games
reinforcement-learning language-grounding natural-language-processing
Language:Python 13
vkurenkov / hierarchical-skill-acquisition
Implementation of the Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learning by Tianmin Shu, Caiming Xiong, and Richard Socher
reinforcement-learning iclr2018 language-grounding multi-task-learning hierarchical-reinforcement-learning
Language:Python 11
vkurenkov / language-grounding-multigoal
An accompanying code and experiments' results for Task-Oriented Language Grounding for Language Input with Multiple Sub-Goals of Non-Linear Order
reinforcement-learning language-grounding multi-goal order-connectors pytorch pytorch-rl reinforcement-learning-environments
Language:Jupyter Notebook 8
FioPio / pepper-language-grounding-system
This repo contains the implelemtation for a simple language grounding in python using the robot Pepper and dockers running the servers for language groundind and speech recognition.
language-grounding pepper-robot python speech-recognition
Language:Python 4
alrichardbollans / spatial-preposition-annotation-tool-unity3d
Spatial Preposition Annotation Tool for Virtual Environments
unity3d spatial-cognition semantics spatial-prepositions polysemy language-grounding spatial-relationships
Language:C# 1
ngthanhtin / Multigoal_VLN_Vizdoom
Fourier Transform Enhanced Vision Language Multi-goal Navigation
language-grounding robot-navigation vision-language multigoal-navigation
Language:Jupyter Notebook 1
thomasaunger / babyai_sr
A package that uses BabyAI in a sender/receiver setup.
reinforcement-learning language-emergence multi-agent-systems language-grounding unsupervised-semantics deep-learning transfer-learning
Language:Python 1
beduffy / anki-robot-experiments
Training anki robots to do simple things e.g. "go to the green cup"
robots reinforcement-learning reinforcement-learning-environments anki natural-language-instructions language-grounding anki-robot-experiments robocar
Language:Python