123penny123

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

VIMABench

Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"

llama

Inference code for Llama models

pyllama

LLaMA: Open and Efficient Foundation Language Models

xuance

XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Awesome-LLM-RL

A comprehensive list of PAPERS, CODEBASES, and, DATASETS on Decision Making using Foundation Models including LLMs and VLMs.

XuanCE-Tiny

A clean framework and implementations for reinforcement learning algorithms.

babyagi

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

LLM-with-RL-papers

A collection of LLM with RL papers

alfred

ALFRED - A Benchmark for Interpreting Grounded Instructions for Everyday Tasks

MineDojo

Building Open-Ended Embodied Agents with Internet-Scale Knowledge

TextWorld

​TextWorld is a sandbox learning environment for the training and evaluation of reinforcement learning (RL) agents on text-based games.

Conference-Acceptance-Rate

Acceptance rates for the major AI conferences

open_flamingo

An open-source framework for training large multimodal models.

RLBench

A large-scale benchmark and learning environment.

peract

Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation

awesome-multi-task-learning

2023 up-to-date list of DATASETS, CODEBASES and PAPERS on Multi-Task Learning (MTL), from Machine Learning perspective.

awesome-vision-language-navigation

A curated list for vision-and-language navigation. ACL 2022 paper "Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions"

VLMbench

NeurIPS 2022 Paper "VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation"

calvin

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

ravens

Train robotic agents to learn pick and place with deep learning for vision-based manipulation in PyBullet. Transporter Nets, CoRL 2020.

babyai

BabyAI platform. A testbed for training agents to understand and execute language commands.

LISA

(NeurIPS '22) LISA: Learning Interpretable Skill Abstractions - A framework for unsupervised skill learning using Imitation

Awesome-LLM-Robotics

A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites

Awesome-Pretrained-RL

carla

Open-source simulator for autonomous driving research.