wangjingbo1219

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

InternLM

Official release of InternLM2 7B and 20B base and chat models. 200K context support

dust3d

Dust3D is a cross-platform 3D modeling software that makes it easy to create low poly 3D models for video games, 3D printing, and more.

xtuner

An efficient, flexible and full-featured toolkit for fine-tuning large models (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

MuseTalk

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

CRATE

Code for CRATE (Coding RAte reduction TransformEr).

diffusion_policy

[RSS 2023] Diffusion Policy Visuomotor Policy Learning via Action Diffusion

MobileVLM

Strong and Open Vision Language Assistant for Mobile Devices

Gaussian-Head-Avatar

[CVPR 2024] Official repository for "Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians"

GeoWizard

[arXiv'24] GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image

eai-vc

The repository for the largest and most comprehensive empirical study of visual foundation models for Embodied AI (EAI).

GPS-Gaussian

[CVPR 2024 Highlight] The official repo for “GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis”

MiniGPT4-video

Official code for MiniGPT4-video

trainable-agents

Code and datasets for "Character-LLM: A Trainable Agent for Role-Playing"

PIP

A real-time system that captures physically correct human motion, joint torques, and ground reaction forces with only 6 inertial measurement units

probe3d

[CVPR 2024] Probing the 3D Awareness of Visual Foundation Models

LL3DA

[CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Language 3D Assistant.

OpenCLAY

CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets

FlowMDM

[CVPR 2024] Official Implementation of "Seamless Human Motion Composition with Blended Positional Encodings".

Paper-List

A paper list of my history reading. Robotics, Learning, Vision.

SLD

🔥 [CVPR2024] Official implementation of "Self-correcting LLM-controlled Diffusion Models (SLD)

insactor

[NeurIPS 2023] InsActor: Instruction-driven Physics-based Characters

UrbanArchitect

The official repository of our paper: "Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior"

Ada-LEval

The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"

QuasiSim

Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer

Portrait-Mode-Video

Video dataset dedicated to portrait-mode video recognition.

SkillDiffuser

[CVPR'2024] "SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Execution"

PhysMoP

Code repository for Incorporating Physics Principles for Precise Human Motion Prediction

HiDiffusion

IceFormer

Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).