hexiangnan / neural_collaborative_filtering

Neural Collaborative Filtering

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Bad performance on the whole test data with all movies

YanXuHappygela opened this issue · comments

The model is evaluated on sampled negatives in the example. I can generate similar result as reported in the paper on the sampled dataset. But when I try to evaluate it on the whole test data with all items as candidate, the HR@10 will drop to around 3%. Any advice on that?

Turn out fine if I exclude the items in the training for each user. I'll close the issue.