wangguanzhi

Voyager

An Open-Ended Embodied Agent with Large Language Models

PyChatGPT

⚡️ Python client for the unofficial ChatGPT API with auto token regeneration, conversation tracking, proxy support and more.

awesome-chatgpt-prompts

This repo includes ChatGPT prompt curation to use ChatGPT better.

Alice

Giving ChatGPT access to a real terminal

VIMABench

Official Task Suite Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"

VIMA

Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"

G.pt

Official PyTorch Implementation of "Learning to Learn with Generative Models of Neural Network Checkpoints"

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

Adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

TaskCreationUI

Awesome-LLM-Robotics

A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites

stable-diffusion

A latent text-to-image diffusion model

MineCLIP

Foundation Model for MineDojo

mpl_plotter

Publication-quality data representation library based on Matplotlib.

Video-Pre-Training

Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos

MineDojo

Building Open-Ended Embodied Agents with Internet-Scale Knowledge

minerl

MineRL Competition for Sample Efficient Reinforcement Learning - Python Package

multimodal

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.

RealSynx

Multiplexed RealSync

SECANT

[ICML 2021] Official code for SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies

code_contests

ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

rlmeta

RLMeta is a light-weight flexible framework for Distributed Reinforcement Learning Research.

dklab_realsync

dkLab RealSync: replicate developer's files over SSH in realtime

cliport

CLIPort: What and Where Pathways for Robotic Manipulation

ravens

Train robotic agents to learn pick and place with deep learning for vision-based manipulation in PyBullet. Transporter Nets, CoRL 2020.

lorel

manipulathor

ManipulaTHOR, a framework that facilitates visual manipulation of objects using a robotic arm

pytorch-cnn-visualizations

Pytorch implementation of convolutional neural network visualization techniques