Reproduce of the GENIA dataset

Question

Reproduce of the GENIA dataset

YuSawan opened this issue 3 years ago · comments

Hi, I cannot reproduce the genia dataset results for f1=83.75 in your paper; the results only reached f1=78.
If available, would you like to give your preprocessed dataset?

YANG Zhiwei · Answer 1 · Fri Mar 26 2021 09:45:54 GMT+0800 (China Standard Time)

@YuSawan Neither do I. Have you reproduced the genia dataset results for f1=83.75 in your paper now?

YuSawan · Answer 2 · Fri Mar 26 2021 14:28:24 GMT+0800 (China Standard Time)

Not yet. I use the genia dataset provided in Obaja's project but it can not reproduce the results.
I think this model uses different preprocessing like eliminates entities with coordinate structure (ex. Human A and B lymphocytes).

yujiahappy · Answer 3 · Wed Apr 07 2021 17:07:41 GMT+0800 (China Standard Time)

Hello! I ran your program on the genia dataset, and the result was 74. Can you give me the data set you have processed?

Xiaoya Li · Answer 4 · Tue Jul 27 2021 22:09:53 GMT+0800 (China Standard Time)

Please use our released data files link for GENIA.
Hyperparameters for reproducing the result can be found here.
Many thanks.

EternalEep · Answer 5 · Thu Nov 04 2021 18:00:28 GMT+0800 (China Standard Time)

Any update of this issue? I have run the experiment with Genia dataset, but only f1 0.79 I can get. I already used your dataset and your genia.sh scripts.