hutslib

videollm-online

VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

VideoLLaMA2

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

parkour

[CoRL 2023] Robot Parkour Learning

ViNL

ViNL: Visual Navigation and Locomotion over Obstacles (ICRA 2023)

GUMP

Generative model for Unified Motion Planning tasks

aide

Master Any Code: One-Click Comments and Language Conversion. 掌握任何屎山代码：一键注释和语言转换。💪

World-Models-Autonomous-Driving-Latest-Survey

A curated list of world models for autonomous driving. Keep updated.

DriveInsight

omnimimic

Cross-Embodiment Robot Learning Codebase

OmniGibson

OmniGibson: a platform for accelerating Embodied AI research built upon NVIDIA's Omniverse engine. Join our Discord for support: https://discord.gg/bccR5vGFEx

GRUtopia

GRUtopia: Dream General Robots in a City at Scale

LCSim

LCSim: A Large-Scale Controllable Traffic Simulator

LLaDA-AV

Driving Everywhere with Large Language Model Policy Adaptation

UniTR

[ICCV2023] Official Implementation of "UniTR: A Unified and Efficient Multi-Modal Transformer for Bird’s-Eye-View Representation"

shap

A game theoretic approach to explain the output of any machine learning model.

OPGP

[ITSC'23] Code for 'Occupancy Prediction-Guided Neural Planner for Autonomous Driving'

LAW

Enhancing End-to-End Autonomous Driving with Latent World Model

SeFlow

[ECCV'24] SeFlow: A Self-Supervised Scene Flow Method in Autonomous Driving

TOD3Cap

[ECCV 2024] TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenes

Hydra-MDP

ManiSkill

SAPIEN Manipulation Skill Framework, a GPU parallelized robotics simulator and benchmark

ABS

openvla

OpenVLA: An open-source vision-language-action model for robotic manipulation.

IsaacLab

Unified framework for robot learning built on NVIDIA Isaac Sim

OmniIsaacGymEnvs

Reinforcement Learning Environments for Omniverse Isaac Gym

reinforcement-learning

Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow. Exercises and Solutions to accompany Sutton's Book and David Silver's course.

Reinforcement-Learning

Learn Deep Reinforcement Learning in 60 days! Lectures & Code in Python. Reinforcement Learning + Deep Learning

metaurban

A Simulation Platform for Embodied AI in Urban Spaces

FasterTransformer

Transformer related optimization, including BERT, GPT

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.