Preprocessing Code not available

Question

Preprocessing Code not available

pranaymanocha opened this issue 7 years ago · comments

Hello,
Can you share the preprocessing code to change the data from original NYT format to pickle format (into multiple such files)? We are currently implementing your paper and needed the code to run the experiments.
Thanks

Yi Wu · Answer 1 · Wed Apr 04 2018 06:10:08 GMT+0800 (China Standard Time)

I have shared the processed pickled data. Check the readme page.

Pranay Manocha · Answer 2 · Wed Apr 04 2018 20:29:40 GMT+0800 (China Standard Time)

Hi. Thanks for replying. I see that but the problem we are facing is that of converting our dataset (which is the original NYT into your pickled data). There seems to be no preprocessing code given, to convert the original NYT into the pickled data

Yi Wu · Answer 3 · Thu Apr 05 2018 05:58:33 GMT+0800 (China Standard Time)

Sorry, I didn't clean that code and currently I do not have bandwidth on this.
The data was simply converted from the NYT data source I mentioned in README, which has been already preprocessed and pretty clean. It is not complicated to convert it to a pickle file.