textured human reconstruction
QHan1st opened this issue · comments
Professor Angjoo Kanazawa:
I want to try to reconstruct the textured human body shape from a single image with your represent model.So,I want to ask you about whether it's feasible or not?Would you give me some suggestions about these?Thanks!
@akanazawa @shubhtuls
Hi,
Human texture is more challenging without any apriori body model since human body shape articulates and disambiguate that with shape is still very hard (in this work we ignored the articulation aspect of the birds). However with an existing human body model, many works explore extracting texture of humans. Gerard has a lot of work in this direction: https://virtualhumans.mpi-inf.mpg.de/publications.html
Also relevant is https://github.com/gulvarol/surreal to see how the humans are textured.
We also have a new work that is slightly of different representation but can recover the surface color of the unseen side from a single image: https://shunsukesaito.github.io/PIFu/
Good luck!
a
Hi,I have a question to consult you. I just want to apply the texture to the car which is already generated.Do I need to generate the sfm of car and train as the follow again ,or can I apply the texture to car directly?Thank you!
@akanazawa
Hi,
I'm a bit confused, is it that you have a 3D model & its camera to align it to the image, but no texture and you want to texture the model?
In this setting it's possible to sample the visible area of the texture, should be a simple operation in graphics, see something like https://learnopengl.com/Getting-started/Textures
If you want the model to give you 3D model and the entire texture, yes you need to train with it.
If you already have a texture image, it's easy to render it with an existing 3D model.
Hope this helps,
Best,
Angjoo
Hi,
I see yes, you'd have to run it. See #5 for more detail.
Depending on what you want to do, there are more methods since this publication, you might want to look at the code release of this paper: https://nv-tlabs.github.io/DIB-R/
good luck!
Angjoo