lokender / PBNS

PBNS: Physically Based Neural Simulation for Unsupervised Outfit Pose Space Deformation.

• Unsupervised: No need of gathering costly PBS data for training your models. Furthermore, PBNS qualitatively outperforms supervised learning.
• Physical consistency: PBNS can generate collision-free cloth-consistent predictions. Cloth consistency ensures no texture distortion or noisy surfaces.
• Cloth properties: Define per-vertex cloth properties. Neurally simulate different fabrics within the same outfit.
• Multiple layers of cloth: PBNS is the only approach able to explicitly handle multiple layers of cloth. This allows modelling whole outfits, instead of single garments.
• Complements: PBNS is not limited to garments. Outfits can be complemented with gloves, boots and more. This defines a common framework for outfit animation.
• Extremely efficient: PBNS can achieve over 14.000 FPS (for an outfit with 24K triangles!). No previous work comes even close to this level of performance. Additionally, the memory footprint of the model is just a few MBs. Because of this, PBNS is the only solution that can be applied in real scenarios like videogames and smartphones (portable virtual try-ons). Moreover, training takes barely a few minutes, even without a GPU!
• Simple formulation: PBNS formulation is the standard on 3D animation. Thus, integrating our approach into ANY rendering pipeline requires minimal engineering effort.

This repository contains the necessary code to run the model described in:
https://arxiv.org/abs/2012.11310

Video:
https://youtu.be/ALwhjm40zRg

Outfit resizing

PBNS formulation also allows unsupervised outfit resizing. That is, retargetting to the desired body shape and control over tightness.
Just as standard PBNS, it can deal with complete outfits with multiple layers of cloth, different fabrics, complements, ...

Enhancing 3D Avatars

Due to the simple formulation of PBNS and no dependency from data, it can be used to easily enhance any 3D custom avatar with realistic outfits in a matter of minutes!

Repository structure

This repository is split into two folders. One is the standard PBNS for outfit animation. The other contains the code for PBNS as a resizer.
Within each folder, you will find instructions on how to use each model.