large content landmarks
KingStorm opened this issue · comments
Hi, thanks for your interest.
Does the eval_L1_loss decrease to 6e-3? as described in this issue.
If not, what is the final eval_L1_loss of your training with custom data?
Since your training dataset includes 5 min 480 x 640 video, I doubt whether it is enough.
Hi, thanks for your interest. Does the eval_L1_loss decrease to 6e-3? as described in this issue. If not, what is the final eval_L1_loss of your training with custom data? Since your training dataset includes 5 min 480 x 640 video, I doubt whether it is enough.
Or, Is your traning overfitting? Compare the running loss and eval loss.
Hi, thanks for your interest. Does the eval_L1_loss decrease to 6e-3? as described in this issue. If not, what is the final eval_L1_loss of your training with custom data? Since your training dataset includes 5 min 480 x 640 video, I doubt whether it is enough.
Thanks for your reply. The eval L1_loss does decrease to 1e-3 level. I would consider it is overfitting enough. And I test it on the training data.
I have drawn sketch during training of landmark
Hi, thanks for your interest.
Does it mean that you draw sketches during training on the training dataset, and draw sketches during inference on the testing dataset?
Hi, thanks for your interest.
As shown in the following code:
https://github.com/Weizhi-Zhong/IP_LAP/blob/e5d8fdc1ab01a1426ac4c8cfec461ec5d024050d/preprocess/preprocess_video.py#LL251C19-L251C19
While preprocessing the LRS2 dataset, we plus 5 extra pixels to the marginal so that the normalized coordinate of most bottom landmarks is not always 1.
Similarly, in the inference:
https://github.com/Weizhi-Zhong/IP_LAP/blob/e5d8fdc1ab01a1426ac4c8cfec461ec5d024050d/inference_single.py#LL282C9-L282C9
we plus some(25) pixels, so the landmarks are within the cropping region.
Depending on your dataset and input videos, you can change the number of pixels added to the marginal region such that all landmarks are within the cropping region.
Hope this can be helpful for you.
thanks, fair enough.