result of paper

Question

result of paper

LYF14020510036 opened this issue 5 years ago · comments

LYF14020510036 commented 5 years ago

I am a beginner. I want to ask you how you got the result of your paper.The results of each validation are the max, and then the max in 10?

Wei-Xiang Sun · Answer 1 · Tue May 21 2019 13:40:35 GMT+0800 (China Standard Time)

I'm also very curious. I try to run the code and to adjust the hyper-parameters, but I cannot got expected results.

Jiezhong Qiu · Answer 2 · Sun Jan 19 2020 15:06:30 GMT+0800 (China Standard Time)

Hey, @LYF14020510036 and @veophi have you solved the problem.

Weihua Hu · Answer 3 · Sun Jan 19 2020 15:46:53 GMT+0800 (China Standard Time)

Thank you for your interest!

To get the results in the paper, you will need to consider tuning hyper-parameters mentioned in the paper (including using --degree_as_tag for COLLAB, IMDB).

Also, in our paper, we did not use validation set (as the dataset sizes are extremely small). Instead, we first took average of validation curves across 10 folds, and then selected a single epoch that achieved the maximum averaged validation accuracy.

Besides, I strongly recommend using graph deep learning libraries that have been recently developed, such as Pytorch Geometric (https://pytorch-geometric.readthedocs.io/en/latest/) and DGL (https://www.dgl.ai/). They provide faster implementation of our GIN algorithm, and are very easy to use.