the performance of ncf in hr@10 didn't achieve 0.7
LiuHao-THU opened this issue · comments
the results of hr@10 using ncf model is blow 0.7,however in paper "neural collaborative filtering" is over 0.72 using factor 32
Thank you for reporting the issue. Could you add the exact hyperparameters settings for this ? NCF is quite sensitive to hyperparameters. I didn't spend a lot of time tuning them. I was suspecting all the weight decay(regularization) and finetuning. Would you like to help with this and report the results here?
here is a link for NCF BPR and NFM
https://github.com/guoyang9/NCF
https://github.com/guoyang9/BPR-pytorch
https://github.com/guoyang9/NFM-pyorch
the scores are exactly the same even higher than origin papers!
Nice points! I checked the repos and found I didn't do the weight initialization tuning. Maybe that's the reason. You could use those repos if you want. I will fix the issue later according to my schedule.
@LiuHao-THU Could you elaborate a bit on factor ? Is it latent factor or predictive factor?