av-savchenko / face-emotion-recognition

Efficient face emotion recognition in photos and videos

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can I get a multi-task learning model file?

saeu5407 opened this issue · comments

Thank you for the good paper.

I'm interested in your work, so I want to check the multi-task learning side, so I'm leaving an issue.
I have two questions.

  1. Multi-task learning training
  1. If understanding is correct, is it correct to freeze the weight of the backbone and learn only the weight of the head?
  2. In this case, is it practically the same as each of you learned?
  1. Multi-task learning model
    Can I get a multi-task learning model file that I learned? I'd like to check Aruosal, Valence, etc.

Hello!
Thanks for your interest to my work
1 and 3. The model trained via multi-task learning on AffectNet to predict facial expressions, valence and arousal is available in this repository: enet_b0_8_va_mtl.pt. The training script for the original version of AffectNet is also available here - see section Multi-task: FER+Valence-Arousal. Finally, there is a source code for multi-task learning challenge from ABAW competition. I do not distribute the model because it does not work well on real video and photos
2. You understand it correctly. It is also possible to finetune the whole network after training new head. Examples are available in the Jupyter notebooks mentioned in item 1 above.

Thank you so much