HDFS log entry count differ between loghub and Deeplog paper

Question

HDFS log entry count differ between loghub and Deeplog paper

EricWebsmith opened this issue 5 years ago · comments

Eric Websmith commented 5 years ago

in Loghub, HDFS1 has 11,175,629 entries.
in Deeplog, the number is 11,197,954 logs.
I am confused.

thanks

zhujiem · Answer 1 · Fri Dec 27 2019 07:27:52 GMT+0800 (China Standard Time)

Sorry for late replay. Our data did not come from Deeplog's paper. We use the same set with our ISSRE paper.

mooks42 · Answer 2 · Sun Apr 10 2022 22:41:05 GMT+0800 (China Standard Time)

Hi, it would be really great if you could change the readme of your HDFS logs.
It looks like HDFS_1 is the same Dataset as used in Detecting Large-Scale System Problems by Mining Console Logs, however the total amount of lines and anomalys is not the same. Therefore, all my work using HDFS_1 and referencing to this publication is wrong :/