关于特殊名词
dwbaron opened this issue · comments
dw commented
类似债券简称,比如“02进出04”,特殊名词比如“5G”,我发现在分词的时候会打散
Sean commented
Thanks for your suggestions, we will fix the problem that can not detect proper noun formed by digital and English alphabet.
dw commented
I tried to combined trie (which perform the exactly match) and hmm seg to fix such problem temporarily.
dw commented
it seems that u first use zh-char to split the sentence, use eng-char seems better?
dw commented
Sean commented
Thanks for your suggestions! I will fix the problem when I free. If you are willing to give contributions to this repo, you can create a PR! Look forward to your contributions!