Danial-Kord / DigiHuman

Automatic 3D Character animation using Pose Estimation and Landmark Generation techniques

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hi, does is possible to mgirate this project to UE based?

lucasjinreal opened this issue · comments

Hi, does is possible to mgirate this project to UE based?

Hey there.
Yes, it is possible. The main architecture of the program is client-server. The AI computations are calculated in the server. Regarding your question, we need to handle outputs of the server in Unreal Engine instead of Unity3D, which is possible but needs some work.
I am considering to expand the features of the application as well as creating the UE version of it and then we would be able to get the benefits of "meta-human" in UE as well :D

@Danial-Kord thank u. It's promising. I would hoping for a UE5 version expecially if it can work on metahuman. It would be awesome. Nice work.

BTW, I am consider make a model based face mocap (without iPhone) using blendshapes, it would be more natural than using mesh or 3d poses. I might PR to u when I finished, so that a more vivid metahuman version could came out.

@Danial-Kord thank u. It's promising. I would hoping for a UE5 version expecially if it can work on metahuman. It would be awesome. Nice work.

Thank you for your comment ^_^

BTW, I am consider make a model based face mocap (without iPhone) using blendshapes, it would be more natural than using mesh or 3d poses. I might PR to u when I finished, so that a more vivid metahuman version could came out.

Wow, that is great. Exactly one of the ways to expand this project is to use a deep neural network model to detect every blend shape weight. That would be awsome good luck :D

@Danial-Kord do u have any estimated timeline on come up with a ue version? I like to test it with mediapipe, not very familliar with unity

@Danial-Kord do u have any estimated timeline on come up with a ue version? I like to test it with mediapipe, not very familliar with unity

Well currently I am focusing on adding more functional features to DigiHuman.
But I think in the next 6 months we can have a UE version of the application available.

@Danial-Kord do u have a discord or telegram? we can further close discuss on detailed topic.

Yeah sure,
Here is my telegram ID: https://t.me/Danial_km

Hey @Danial-Kord @jinfagang ,
May i join too, to achieve our common goal towards Metahuman.

@ujjawalcse sure, add my telegram, let's talk in a group: lucasjinreal

Found @Danial-Kord on telegram but couldn't find you @jinfagang .
you can connect me with @ujjawal_ks.