ShannonAI / mrc-for-flat-nested-ner

Code for ACL 2020 paper `A Unified MRC Framework for Named Entity Recognition`

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

inference

447428054 opened this issue · comments

@xiaoya-li @YuxianMeng @littlesulley after train, i use mrc-for-flat-nested-ner/scripts/mrc_ner/nested_inference.sh to do inference , but the start is always 0, ACE04 log are as follows:
==========
Given input: geographical political entities are geographical regions defined by political and or social groups such as countries, nations, regions, cities, states, government and its people. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: [(0, 41, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] he holds that according to the experience of asian', 'GPE')]
==========
Given input: organization entities are limited to companies, corporations, agencies, institutions and other groups of people. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: []
==========
Given input: a person entity is limited to human including a single individual or a group. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: [(0, 18, '[CLS] a person entity is limited to human including a single individual or a group . [SEP] he', 'PER')]
==========
Given input: facility entities are limited to buildings and other permanent man - made structures such as buildings, airports, highways, bridges. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: []
==========
Given input: vehicle entities are physical devices primarily designed to move, carry, pull or push the transported object such as helicopters, trains, ship and motorcycles. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: []
==========
Given input: location entities are limited to geographical entities such as geographical areas and landmasses, mountains, bodies of water, and geological formations. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: []
==========
Given input: weapon entities are limited to physical devices such as instruments for physically harming such as guns, arms and gunpowder. he holds that according to the experience of asian energy market development, liquefied natural gas has become the main material of clean fuel used for electricity generation.
Model predict: []
==========
Given input: geographical political entities are geographical regions defined by political and or social groups such as countries, nations, regions, cities, states, government and its people. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: [(0, 42, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] when the gross national product per capita reached 3000 us', 'GPE'), (0, 45, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] when the gross national product per capita reached 3000 us dollars in japan', 'GPE'), (0, 47, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] when the gross national product per capita reached 3000 us dollars in japan , south', 'GPE'), (0, 50, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] when the gross national product per capita reached 3000 us dollars in japan , south korea and taiwan', 'GPE'), (0, 50, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] when the gross national product per capita reached 3000 us dollars in japan , south korea and taiwan', 'GPE'), (0, 52, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] when the gross national product per capita reached 3000 us dollars in japan , south korea and taiwan , etc', 'GPE')]
==========
Given input: organization entities are limited to companies, corporations, agencies, institutions and other groups of people. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: []
==========
Given input: a person entity is limited to human including a single individual or a group. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: []
==========
Given input: facility entities are limited to buildings and other permanent man - made structures such as buildings, airports, highways, bridges. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: []
==========
Given input: vehicle entities are physical devices primarily designed to move, carry, pull or push the transported object such as helicopters, trains, ship and motorcycles. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: []
==========
Given input: location entities are limited to geographical entities such as geographical areas and landmasses, mountains, bodies of water, and geological formations. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: []
==========
Given input: weapon entities are limited to physical devices such as instruments for physically harming such as guns, arms and gunpowder. when the gross national product per capita reached 3000 us dollars in japan, south korea and taiwan, etc., environmental protection awareness generally rose, and all began to obviously increase usage of electricity generated by liquefied natural gas.
Model predict: [(0, 64, '[CLS] weapon entities are limited to physical devices such as instruments for physically harming such as guns , arms and gunpowder . [SEP] when the gross national product per capita reached 3000 us dollars in japan , south korea and taiwan , etc . , environmental protection awareness generally rose , and all began to obviously increase usage of electricity generated by li', 'WEA')]
==========
Given input: geographical political entities are geographical regions defined by political and or social groups such as countries, nations, regions, cities, states, government and its people. as the gross national product in china's coastal regions begins to approach this benchmark, it can be said to have had the conditions for electricity generation using natural gas in terms of financial resources.
Model predict: [(0, 39, '[CLS] geographical political entities are geographical regions defined by political and or social groups such as countries , nations , regions , cities , states , government and its people . [SEP] as the gross national product in china', 'GPE')]

commented

hi ~ I also meet this problem, did you solve it?

@xiaoya-li @littlesulley @YuxianMeng hi, Can you help us solve this problem

Sorry for the late reply. I will give a response before 22-nd Nov.

commented

Thank you!

hello! Has the problem been solved?

@447428054 @SMinL hello! Has the problem been solved?

hi i get it !
here code : return [(pos[1], pos[2],pseudo_tag) for pos in match_pos_pairs]
index is wrong in method "extract_nested_spans" from query_span_f1.py

hello?would you know how to deal with the problem of invalid inputs when runing the code msra2mrc.py?I feel so appreciated if you would give me a reply!!