zfan20 / GraphDA

SIGIR 2023 "Graph Collaborative Signals Denoising and Augmentation for Recommendation"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The experimental results seem to differ from what is mentioned in the paper.

TaoWang666 opened this issue · comments

Hello! It seems that when I replicated your code yesterday and ran the Enhanced-UI and GraphDA experiments using the provided commands, the reproduced results did not match the actual data mentioned in your paper. Specifically, the experimental data for Enhanced-UI was significantly higher than the actual data in your paper, while the experimental data for GraphDA was slightly lower than the actual data in your paper.

This is the replication result for Enhanced-UI.
Enhanced-UI

This is the replication result for GraphDA.
GraphDA

As usual, again, the reported results come from the grid-searched experiments instead of one single run. It does not make sense to run all methods (baselines and our methods) in only one shot. The command shown in the readme is only an example to run.

Thank you very much for your response!