wangjingbo1219

MiraData

LLM-in-Vision

Recent LLM-based CV and related works. Welcome to comment/contribute!

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

mixture-density-network

Mixture density network implemented in PyTorch.

Rofunc

🤖 The Full Process Python Package for Robot Learning from Demonstration and Robot Manipulation

generative-ai-for-beginners

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

LIBERO

Benchmarking Knowledge Transfer in Lifelong Robot Learning

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

CameraCtrl

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

MimicPlay

"MimicPlay: Long-Horizon Imitation Learning by Watching Human Play" code repository

awesome-diffusion-model-in-rl

A curated list of Diffusion Model in RL resources (continually updated)

GART

GART: Gaussian Articulated Template Models

tram

TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

efficientvit

EfficientViT is a new family of vision models for efficient high-resolution vision.

momask-codes

Official implementation of "MoMask: Generative Masked Modeling of 3D Human Motions (CVPR2024)"

SuperNormal

[CVPR 2024] Official implementation of "SuperNormal: Neural Surface Reconstruction via Multi-View Normal Integration"

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

ect

Consistency Models Made Easy

motion-planner-reinforcement-learning

End to end motion planner using Deep Deterministic Policy Gradient (DDPG) in gazebo

Duolando

Code for ICLR 2024 paper "Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment"

humanoid-bench

octo

Octo is a transformer-based robot policy trained on a diverse mix of 800k robot trajectories.

embodied-generalist

[ICML 2024] Official code repository for 3D embodied generalist agent LEO

GraspXL

This is a repository for GraspXL, which can generate objective-drive grasping motions for 500k+ objects with different dexterous hands.

UniTraj

A Unified Framework for scalable Vehicle Trajectory Prediction

AnimatableGaussians

Code of [CVPR 2024] "Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling"

PULSE

Official Implementation of the ICLR 2023 spotlight paper: Universal Humanoid Motion Representations for Physics-Based Control

droid_policy_learning

DROID Policy Learning and Evaluation