Test Dataloader for large dataset.
RuihongQiu opened this issue · comments
Maybe a test dataloader for iterate the test set is more user friendly for large dataset? Just simply treat all test data as a huge batch sometimes will cause OOM error.
Sometimes the size could be like this.
Couldn't agree more. A test dataloader would be better. I will add it to my todo list.
Hope to see the method. I try to implement it but get stuck in the calculation of HR and NDCG.