malllabiisc / RESIDE

EMNLP 2018: RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Performance without relation alias

fufrank5 opened this issue · comments

Hi,

I think the second bar in Figure 4 and the last bar in Figure 5 both represents the performance without relation alias. But one seems to be 0.41, while the other looks close to 0.39. Why is there a big difference?

Thanks,
Lisheng

Hi Lisheng,
There is some difference in the evaluation setting in Figure 4 and Figure 5. In Figure 4 the relation alias component has been completely removed from the network whereas in Figure 5 as the relation aliases are not available all relation phrases have been mapped to NA relation which introduces some noise in the sentence representation thus degrading the overall performance.

Thanks

I see. Thank you.